[jira] [Commented] (SPARK-28735) MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction fails on JDK11

2019-08-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907821#comment-16907821 ] Hyukjin Kwon commented on SPARK-28735: -- Let me take a look tomorrow in KST. >

[jira] [Created] (SPARK-28740) Add support for building with bloop

2019-08-14 Thread holdenk (JIRA)
holdenk created SPARK-28740: --- Summary: Add support for building with bloop Key: SPARK-28740 URL: https://issues.apache.org/jira/browse/SPARK-28740 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-28666) Support the V2SessionCatalog in saveAsTable

2019-08-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28666. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25402

[jira] [Assigned] (SPARK-28666) Support the V2SessionCatalog in saveAsTable

2019-08-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28666: --- Assignee: Burak Yavuz > Support the V2SessionCatalog in saveAsTable >

[jira] [Assigned] (SPARK-28351) Support DELETE in DataSource V2

2019-08-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28351: --- Assignee: Xianyin Xin > Support DELETE in DataSource V2 > ---

[jira] [Resolved] (SPARK-28351) Support DELETE in DataSource V2

2019-08-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28351. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25115

[jira] [Resolved] (SPARK-28203) PythonRDD should respect SparkContext's conf when passing user confMap

2019-08-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28203. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25002

[jira] [Assigned] (SPARK-28203) PythonRDD should respect SparkContext's conf when passing user confMap

2019-08-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28203: Assignee: Xianjin YE > PythonRDD should respect SparkContext's conf when passing user

[jira] [Updated] (SPARK-28723) Upgrade to Hive 2.3.6 for HiveMetastore Client and Hadoop-3.2 profile

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28723: -- Parent Issue: SPARK-28684 (was: SPARK-24417) > Upgrade to Hive 2.3.6 for HiveMetastore

[jira] [Updated] (SPARK-28710) [UDF] create or replace permanent function does not clear the jar in class path

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28710: -- Description: {code} 0: jdbc:hive2://10.18.19.208:23040/default> create function addDoubles

[jira] [Commented] (SPARK-28710) [UDF] create or replace permanent function does not clear the jar in class path

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907681#comment-16907681 ] Dongjoon Hyun commented on SPARK-28710: --- Thank you for reporting this, [~abhishek.akg]. Thank you

[jira] [Comment Edited] (SPARK-28738) Add ability to include metadata in CanCommitOffsets API

2019-08-14 Thread Joseph Cooper (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907642#comment-16907642 ] Joseph Cooper edited comment on SPARK-28738 at 8/14/19 10:43 PM: - I

[jira] [Updated] (SPARK-28738) Add ability to include metadata in CanCommitOffsets API

2019-08-14 Thread Joseph Cooper (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph Cooper updated SPARK-28738: -- Description: It is possible to commit metadata with an offset to Kafka. Currently, the

[jira] [Resolved] (SPARK-28110) on JDK11, IsolatedClientLoader must be able to load java.sql classes

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28110. --- Resolution: Duplicate > on JDK11, IsolatedClientLoader must be able to load java.sql

[jira] [Commented] (SPARK-28110) on JDK11, IsolatedClientLoader must be able to load java.sql classes

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907671#comment-16907671 ] Dongjoon Hyun commented on SPARK-28110: --- Yes, it does. Although SPARK-28723 provides a solution

[jira] [Commented] (SPARK-28701) add java11 support for spark pull request builds

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907654#comment-16907654 ] Dongjoon Hyun commented on SPARK-28701: --- Thanks, [~shaneknapp]! :D > add java11 support for spark

[jira] [Comment Edited] (SPARK-28738) Add ability to include metadata in CanCommitOffsets API

2019-08-14 Thread Joseph Cooper (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907642#comment-16907642 ] Joseph Cooper edited comment on SPARK-28738 at 8/14/19 9:52 PM: I think

[jira] [Comment Edited] (SPARK-28738) Add ability to include metadata in CanCommitOffsets API

2019-08-14 Thread Joseph Cooper (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907642#comment-16907642 ] Joseph Cooper edited comment on SPARK-28738 at 8/14/19 9:42 PM: I think

[jira] [Reopened] (SPARK-23519) Create View Commands Fails with The view output (col1,col1) contains duplicate column name

2019-08-14 Thread Franck Tago (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Franck Tago reopened SPARK-23519: - Ok Spark Community  I am sorry for being a pest about this , but I re-opening this Jira because I

[jira] [Commented] (SPARK-28738) Add ability to include metadata in CanCommitOffsets API

2019-08-14 Thread Joseph Cooper (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907642#comment-16907642 ] Joseph Cooper commented on SPARK-28738: --- I think I see why commitAsync might not support this.

[jira] [Commented] (SPARK-28728) Bump Jackson Databind to 2.9.9.3

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907635#comment-16907635 ] Dongjoon Hyun commented on SPARK-28728: --- [~Fokko]. Thank you for making a JIRA and PR, but Apache

[jira] [Updated] (SPARK-28728) Bump Jackson Databind to 2.9.9.3

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28728: -- Fix Version/s: (was: 2.4.4) (was: 3.0.0) > Bump Jackson Databind

[jira] [Resolved] (SPARK-28721) Failing to stop SparkSession in K8S cluster mode PySpark leaks Driver and Executors

2019-08-14 Thread Patrick Clay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Clay resolved SPARK-28721. -- Resolution: Duplicate Ah sorry I didn't search carefully enough for a duplicate > Failing to

[jira] [Created] (SPARK-28738) Add ability to include metadata in CanCommitOffsets API

2019-08-14 Thread Joseph Cooper (JIRA)
Joseph Cooper created SPARK-28738: - Summary: Add ability to include metadata in CanCommitOffsets API Key: SPARK-28738 URL: https://issues.apache.org/jira/browse/SPARK-28738 Project: Spark

[jira] [Updated] (SPARK-28683) Upgrade Scala to 2.12.10

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28683: -- Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-24417) > Upgrade

[jira] [Commented] (SPARK-28683) Upgrade Scala to 2.12.10

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907619#comment-16907619 ] Dongjoon Hyun commented on SPARK-28683: --- I got it. Yes. This is a nice-to-have. I'll put this out

[jira] [Created] (SPARK-28737) Update jersey to 2.27+ (2.29)

2019-08-14 Thread Sean Owen (JIRA)
Sean Owen created SPARK-28737: - Summary: Update jersey to 2.27+ (2.29) Key: SPARK-28737 URL: https://issues.apache.org/jira/browse/SPARK-28737 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-28683) Upgrade Scala to 2.12.10

2019-08-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907606#comment-16907606 ] Sean Owen commented on SPARK-28683: --- I think we can detach this from the JDK 11 umbrella. This doesn't

[jira] [Commented] (SPARK-28110) on JDK11, IsolatedClientLoader must be able to load java.sql classes

2019-08-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907604#comment-16907604 ] Sean Owen commented on SPARK-28110: --- Is this one still an issue? I think this is a clone of an older

[jira] [Updated] (SPARK-28736) pyspark.mllib.clustering fails on JDK11

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28736: -- Description: Build Spark and run PySpark UT with JDK11. {code} $ build/sbt -Phadoop-3.2

[jira] [Created] (SPARK-28736) pyspark.mllib.clustering fails on JDK11

2019-08-14 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-28736: - Summary: pyspark.mllib.clustering fails on JDK11 Key: SPARK-28736 URL: https://issues.apache.org/jira/browse/SPARK-28736 Project: Spark Issue Type:

[jira] [Updated] (SPARK-28735) MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction fails on JDK11

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28735: -- Description: Build Spark and run PySpark UT with JDK11. The last commented `assertTrue`

[jira] [Updated] (SPARK-28735) MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction fails on JDK11

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28735: -- Description: Build Spark with JDK11 and run `python/run-tests --testnames

[jira] [Updated] (SPARK-28735) MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction fails on JDK11

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28735: -- Description: Build Spark with JDK11 and run `python/run-tests --testnames

[jira] [Created] (SPARK-28735) MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction fails on JDK11

2019-08-14 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-28735: - Summary: MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction fails on JDK11 Key: SPARK-28735 URL: https://issues.apache.org/jira/browse/SPARK-28735

[jira] [Commented] (SPARK-27361) YARN support for GPU-aware scheduling

2019-08-14 Thread Parth Gandhi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907551#comment-16907551 ] Parth Gandhi commented on SPARK-27361: -- Makes sense, thank you. > YARN support for GPU-aware

[jira] [Created] (SPARK-28734) Create a table of content in the left hand side bar for SQL doc.

2019-08-14 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-28734: Summary: Create a table of content in the left hand side bar for SQL doc. Key: SPARK-28734 URL: https://issues.apache.org/jira/browse/SPARK-28734 Project: Spark

[jira] [Commented] (SPARK-28721) Failing to stop SparkSession in K8S cluster mode PySpark leaks Driver and Executors

2019-08-14 Thread Patrick Clay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907522#comment-16907522 ] Patrick Clay commented on SPARK-28721: -- I confirmed this affects 2.4.1, and re-confirmed that it

[jira] [Updated] (SPARK-28721) Failing to stop SparkSession in K8S cluster mode PySpark leaks Driver and Executors

2019-08-14 Thread Patrick Clay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Clay updated SPARK-28721: - Affects Version/s: 2.4.1 > Failing to stop SparkSession in K8S cluster mode PySpark leaks

[jira] [Commented] (SPARK-27931) Accept 'on' and 'off' as input for boolean data type

2019-08-14 Thread YoungGyu Chun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907514#comment-16907514 ] YoungGyu Chun commented on SPARK-27931: --- I'll be working on this > Accept 'on' and 'off' as input

[jira] [Commented] (SPARK-27361) YARN support for GPU-aware scheduling

2019-08-14 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907431#comment-16907431 ] Thomas Graves commented on SPARK-27361: --- Since that was done prior to this feature, I think its ok

[jira] [Commented] (SPARK-28701) add java11 support for spark pull request builds

2019-08-14 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907394#comment-16907394 ] shane knapp commented on SPARK-28701: - [~dongjoon] whoops! i just fixed that build... also, i'm

[jira] [Commented] (SPARK-27361) YARN support for GPU-aware scheduling

2019-08-14 Thread Parth Gandhi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907391#comment-16907391 ] Parth Gandhi commented on SPARK-27361: -- [~tgraves], I was just wondering whether 

[jira] [Resolved] (SPARK-28687) Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()`

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28687. --- Resolution: Fixed Issue resolved by pull request 25408

[jira] [Resolved] (SPARK-27739) df.persist should save stats from optimized plan

2019-08-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27739. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24623

[jira] [Created] (SPARK-28733) DataFrameReader of Spark not able to recognize the very first quote character, while custom unicode quote character is used

2019-08-14 Thread Mrinal Bhattacherjee (JIRA)
Mrinal Bhattacherjee created SPARK-28733: Summary: DataFrameReader of Spark not able to recognize the very first quote character, while custom unicode quote character is used Key: SPARK-28733 URL:

[jira] [Updated] (SPARK-28732) org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator - failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java' when storing t

2019-08-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-28732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alix Métivier updated SPARK-28732: -- Description: I am using agg function on a dataset, and i want to count the number of lines

[jira] [Updated] (SPARK-28732) org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator - failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java' when storing t

2019-08-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-28732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alix Métivier updated SPARK-28732: -- Description: I am using agg function on a dataset, and i want to count the number of lines

[jira] [Created] (SPARK-28732) org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator - failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java' when storing t

2019-08-14 Thread JIRA
Alix Métivier created SPARK-28732: - Summary: org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator - failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java' when storing the result of a count

[jira] [Updated] (SPARK-28731) Support limit on recursive queries

2019-08-14 Thread Peter Toth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-28731: --- Description: Recursive queries should support LIMIT and stop recursion if the required amount of

[jira] [Created] (SPARK-28731) Support limit on recursive queries

2019-08-14 Thread Peter Toth (JIRA)
Peter Toth created SPARK-28731: -- Summary: Support limit on recursive queries Key: SPARK-28731 URL: https://issues.apache.org/jira/browse/SPARK-28731 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-28730) Configurable type coercion policy for table insertion

2019-08-14 Thread Gengliang Wang (JIRA)
Gengliang Wang created SPARK-28730: -- Summary: Configurable type coercion policy for table insertion Key: SPARK-28730 URL: https://issues.apache.org/jira/browse/SPARK-28730 Project: Spark

[jira] [Assigned] (SPARK-27739) df.persist should save stats from optimized plan

2019-08-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27739: --- Assignee: John Zhuge > df.persist should save stats from optimized plan >

[jira] [Updated] (SPARK-28728) Bump Jackson Databind to 2.9.9.3

2019-08-14 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated SPARK-28728: - Description: (was: Due to CVE's:

[jira] [Updated] (SPARK-28728) Bump Jackson Databind to 2.9.9.3

2019-08-14 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated SPARK-28728: - Description: Needs to be upgraded due to issues. > Bump Jackson Databind to 2.9.9.3 >

[jira] [Commented] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

2019-08-14 Thread angerszhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907131#comment-16907131 ] angerszhu commented on SPARK-28726: --- [~ajithshetty]   also happen when higher timeouts > Spark with

[jira] [Commented] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

2019-08-14 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907112#comment-16907112 ] Ajith S commented on SPARK-28726: - As i see, this is driver trying to clean up RDDs, broadcasts etc from

[jira] [Created] (SPARK-28729) Comparison between DecimalType and StringType may lead to wrong results

2019-08-14 Thread ShuMing Li (JIRA)
ShuMing Li created SPARK-28729: -- Summary: Comparison between DecimalType and StringType may lead to wrong results Key: SPARK-28729 URL: https://issues.apache.org/jira/browse/SPARK-28729 Project: Spark

[jira] [Commented] (SPARK-28367) Kafka connector infinite wait because metadata never updated

2019-08-14 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907016#comment-16907016 ] Gabor Somogyi commented on SPARK-28367: --- It has been turned out new API from Kafka side is needed

[jira] [Created] (SPARK-28728) Bump Jackson Databind to 2.9.9.3

2019-08-14 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created SPARK-28728: Summary: Bump Jackson Databind to 2.9.9.3 Key: SPARK-28728 URL: https://issues.apache.org/jira/browse/SPARK-28728 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-28727) Request for partial least square (PLS) regression model

2019-08-14 Thread Nikunj (JIRA)
Nikunj created SPARK-28727: -- Summary: Request for partial least square (PLS) regression model Key: SPARK-28727 URL: https://issues.apache.org/jira/browse/SPARK-28727 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

2019-08-14 Thread angerszhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28726: -- Description: When use Spark with dynamic allocation, we set idle time to 5s We always got exception

[jira] [Created] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

2019-08-14 Thread angerszhu (JIRA)
angerszhu created SPARK-28726: - Summary: Spark with DynamicAllocation always got connect rest by peers Key: SPARK-28726 URL: https://issues.apache.org/jira/browse/SPARK-28726 Project: Spark

[jira] [Created] (SPARK-28725) Spark ML not able to de-serialize Logistic Regression model saved in previous version of Spark

2019-08-14 Thread Sharad Varshney (JIRA)
Sharad Varshney created SPARK-28725: --- Summary: Spark ML not able to de-serialize Logistic Regression model saved in previous version of Spark Key: SPARK-28725 URL:

[jira] [Assigned] (SPARK-28265) Missing TableCatalog API to rename table

2019-08-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28265: --- Assignee: Edgar Rodriguez > Missing TableCatalog API to rename table >

[jira] [Resolved] (SPARK-28711) [SQL] ThriftServer is not starting after upgrading the spark to 3.0

2019-08-14 Thread Sandeep Katta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Katta resolved SPARK-28711. --- Resolution: Not A Bug > [SQL] ThriftServer is not starting after upgrading the spark to 3.0

[jira] [Resolved] (SPARK-28265) Missing TableCatalog API to rename table

2019-08-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28265. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25206