[jira] [Commented] (SPARK-23498) Accuracy problem in comparison with string and integer

[ https://issues.apache.org/jira/browse/SPARK-23498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383373#comment-16383373 ] Marco Gaido commented on SPARK-23498: - I think we are seeing many of these issues wit

[jira] [Created] (SPARK-23564) the optimized logical plan about Left anti join should be further optimization

KaiXinXIaoLei created SPARK-23564: - Summary: the optimized logical plan about Left anti join should be further optimization Key: SPARK-23564 URL: https://issues.apache.org/jira/browse/SPARK-23564 Pro

[jira] [Commented] (SPARK-20162) Reading data from MySQL - Cannot up cast from decimal(30,6) to decimal(38,18)

[ https://issues.apache.org/jira/browse/SPARK-20162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383471#comment-16383471 ] Caio Quirino da Silva commented on SPARK-20162: --- I have reproduced the prob

[jira] [Commented] (SPARK-20162) Reading data from MySQL - Cannot up cast from decimal(30,6) to decimal(38,18)

[ https://issues.apache.org/jira/browse/SPARK-20162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383522#comment-16383522 ] Hyukjin Kwon commented on SPARK-20162: -- I think it's more specific to Avro datasourc

[jira] [Commented] (SPARK-7721) Generate test coverage report from Python

[ https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383532#comment-16383532 ] Hyukjin Kwon commented on SPARK-7721: - [~rxin], I am sorry that it's been delayed. I w

[jira] [Commented] (SPARK-23474) mapWithState + async operations = no checkpointing

[ https://issues.apache.org/jira/browse/SPARK-23474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383566#comment-16383566 ] Daniel Lanza García commented on SPARK-23474: - Thanks [~gsomogyi] Does your

[jira] [Created] (SPARK-23565) Improved error message for when the number of sources for a query changes

Patrick McGloin created SPARK-23565: --- Summary: Improved error message for when the number of sources for a query changes Key: SPARK-23565 URL: https://issues.apache.org/jira/browse/SPARK-23565 Proje

[jira] [Updated] (SPARK-23565) Improved error message for when the number of sources for a query changes

[ https://issues.apache.org/jira/browse/SPARK-23565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick McGloin updated SPARK-23565: Description: If you change the number of sources for a Structured Streaming query then you

[jira] [Created] (SPARK-23566) Arguement name fix

Anirudh created SPARK-23566: --- Summary: Arguement name fix Key: SPARK-23566 URL: https://issues.apache.org/jira/browse/SPARK-23566 Project: Spark Issue Type: Documentation Components: Docu

[jira] [Updated] (SPARK-23566) Arguement name fix

[ https://issues.apache.org/jira/browse/SPARK-23566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh updated SPARK-23566: Flags: Patch External issue URL: https://github.com/apache/spark/pull/20716 > Arguement na

[jira] [Commented] (SPARK-23566) Arguement name fix

[ https://issues.apache.org/jira/browse/SPARK-23566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383593#comment-16383593 ] Apache Spark commented on SPARK-23566: -- User 'animenon' has created a pull request f

[jira] [Assigned] (SPARK-23566) Arguement name fix

[ https://issues.apache.org/jira/browse/SPARK-23566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23566: Assignee: (was: Apache Spark) > Arguement name fix > -- > >

[jira] [Assigned] (SPARK-23566) Arguement name fix

[ https://issues.apache.org/jira/browse/SPARK-23566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23566: Assignee: Apache Spark > Arguement name fix > -- > > Key:

[jira] [Commented] (SPARK-22479) SaveIntoDataSourceCommand logs jdbc credentials

[ https://issues.apache.org/jira/browse/SPARK-22479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383709#comment-16383709 ] Thomas Graves commented on SPARK-22479: --- [~aash] [~onursatici] this seems to have r

[jira] [Commented] (SPARK-23554) Hive's textinputformat.record.delimiter equivalent in Spark

[ https://issues.apache.org/jira/browse/SPARK-23554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383715#comment-16383715 ] Ruslan Dautkhanov commented on SPARK-23554: --- Yep it is. Thanks [~hyukjin.kwon].

[jira] [Created] (SPARK-23567) spark.redaction.regex should not include user by default, docs not updated

Thomas Graves created SPARK-23567: - Summary: spark.redaction.regex should not include user by default, docs not updated Key: SPARK-23567 URL: https://issues.apache.org/jira/browse/SPARK-23567 Project:

[jira] [Commented] (SPARK-23567) spark.redaction.regex should not include user by default, docs not updated

[ https://issues.apache.org/jira/browse/SPARK-23567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383723#comment-16383723 ] Thomas Graves commented on SPARK-23567: --- I also question whether the url should be

[jira] [Commented] (SPARK-22479) SaveIntoDataSourceCommand logs jdbc credentials

[ https://issues.apache.org/jira/browse/SPARK-22479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383733#comment-16383733 ] Thomas Graves commented on SPARK-22479: --- Also the example above shows the password,

[jira] [Comment Edited] (SPARK-23567) spark.redaction.regex should not include user by default, docs not updated

[ https://issues.apache.org/jira/browse/SPARK-23567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383723#comment-16383723 ] Thomas Graves edited comment on SPARK-23567 at 3/2/18 3:57 PM:

[jira] [Commented] (SPARK-23564) the optimized logical plan about Left anti join should be further optimization

[ https://issues.apache.org/jira/browse/SPARK-23564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383786#comment-16383786 ] Apache Spark commented on SPARK-23564: -- User 'mgaido91' has created a pull request f

[jira] [Assigned] (SPARK-23564) the optimized logical plan about Left anti join should be further optimization

[ https://issues.apache.org/jira/browse/SPARK-23564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23564: Assignee: (was: Apache Spark) > the optimized logical plan about Left anti join shoul

[jira] [Assigned] (SPARK-23564) the optimized logical plan about Left anti join should be further optimization

[ https://issues.apache.org/jira/browse/SPARK-23564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23564: Assignee: Apache Spark > the optimized logical plan about Left anti join should be furthe

[jira] [Commented] (SPARK-15693) Write schema definition out for file-based data sources to avoid schema inference

[ https://issues.apache.org/jira/browse/SPARK-15693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383787#comment-16383787 ] Jayesh Thakrar commented on SPARK-15693: Hello [~rxin] - just to clarify about th

[jira] [Created] (SPARK-23568) Silhouette should get number of features from metadata if available

Marco Gaido created SPARK-23568: --- Summary: Silhouette should get number of features from metadata if available Key: SPARK-23568 URL: https://issues.apache.org/jira/browse/SPARK-23568 Project: Spark

[jira] [Commented] (SPARK-18492) GeneratedIterator grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383834#comment-16383834 ] imran shaik commented on SPARK-18492: - Facing the same issue: Spark Version: 2.2.1

[jira] [Commented] (SPARK-23514) Replace spark.sparkContext.hadoopConfiguration by spark.sessionState.newHadoopConf()

[ https://issues.apache.org/jira/browse/SPARK-23514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383838#comment-16383838 ] Apache Spark commented on SPARK-23514: -- User 'juliuszsompolski' has created a pull r

[jira] [Commented] (SPARK-18492) GeneratedIterator grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383843#comment-16383843 ] Nicholas Chammas commented on SPARK-18492: -- Are you seeing the same on Spark 2.3

[jira] [Assigned] (SPARK-23568) Silhouette should get number of features from metadata if available

[ https://issues.apache.org/jira/browse/SPARK-23568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23568: Assignee: (was: Apache Spark) > Silhouette should get number of features from metadata

[jira] [Assigned] (SPARK-23568) Silhouette should get number of features from metadata if available

[ https://issues.apache.org/jira/browse/SPARK-23568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23568: Assignee: Apache Spark > Silhouette should get number of features from metadata if availab

[jira] [Commented] (SPARK-23568) Silhouette should get number of features from metadata if available

[ https://issues.apache.org/jira/browse/SPARK-23568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383849#comment-16383849 ] Apache Spark commented on SPARK-23568: -- User 'mgaido91' has created a pull request f

[jira] [Commented] (SPARK-18492) GeneratedIterator grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383868#comment-16383868 ] imran shaik commented on SPARK-18492: - I will try to reproduce the error on Spark 2.3

[jira] [Updated] (SPARK-18492) GeneratedIterator grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] imran shaik updated SPARK-18492: Attachment: Screenshot from 2018-03-02 12-57-51.png > GeneratedIterator grows beyond 64 KB > --

[jira] [Commented] (SPARK-18492) GeneratedIterator grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383891#comment-16383891 ] imran shaik commented on SPARK-18492: - Spark 2.3.0 has same issue unfortunately Here

[jira] [Commented] (SPARK-18492) GeneratedIterator grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383933#comment-16383933 ] Kazuaki Ishizaki commented on SPARK-18492: -- Thank you for reporting the issue. W

[jira] [Commented] (SPARK-18492) GeneratedIterator grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383936#comment-16383936 ] Kazuaki Ishizaki commented on SPARK-18492: -- According to the screenshot, the num

[jira] [Resolved] (SPARK-23239) KafkaRelationSuite should clean up its continuous queries

[ https://issues.apache.org/jira/browse/SPARK-23239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-23239. --- Resolution: Cannot Reproduce > KafkaRelationSuite should clean up its continuous queries > --

[jira] [Commented] (SPARK-18492) GeneratedIterator grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383950#comment-16383950 ] imran shaik commented on SPARK-18492: - val stremingagg = truetradescast.groupBy($"Sym

[jira] [Resolved] (SPARK-23518) Avoid metastore access when users only want to read and store data frames

[ https://issues.apache.org/jira/browse/SPARK-23518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23518. - Resolution: Fixed Fix Version/s: 2.4.0 > Avoid metastore access when users only want to read and s

[jira] [Assigned] (SPARK-23518) Avoid metastore access when users only want to read and store data frames

[ https://issues.apache.org/jira/browse/SPARK-23518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-23518: --- Assignee: Feng Liu > Avoid metastore access when users only want to read and store data frames > ---

[jira] [Commented] (SPARK-23437) [ML] Distributed Gaussian Process Regression for MLlib

[ https://issues.apache.org/jira/browse/SPARK-23437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383980#comment-16383980 ] Valeriy Avanesov commented on SPARK-23437: -- I've created a repo. https://github.

[jira] [Created] (SPARK-23569) pandas_udf does not work with type-annotated python functions

Stu (Michael Stewart) created SPARK-23569: - Summary: pandas_udf does not work with type-annotated python functions Key: SPARK-23569 URL: https://issues.apache.org/jira/browse/SPARK-23569 Proje

[jira] [Updated] (SPARK-23569) pandas_udf does not work with type-annotated python functions

[ https://issues.apache.org/jira/browse/SPARK-23569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stu (Michael Stewart) updated SPARK-23569: -- Environment: pyspark 2.3.0 | Using Scala version 2.11.8, OpenJDK 64-Bit Server

[jira] [Updated] (SPARK-23569) pandas_udf does not work with type-annotated python functions

[ https://issues.apache.org/jira/browse/SPARK-23569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stu (Michael Stewart) updated SPARK-23569: -- Environment: python 3.6 | pyspark 2.3.0 | Using Scala version 2.11.8, OpenJDK 6

[jira] [Updated] (SPARK-23569) pandas_udf does not work with type-annotated python functions

[ https://issues.apache.org/jira/browse/SPARK-23569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stu (Michael Stewart) updated SPARK-23569: -- Description: When invoked against a type annotated function pandas_udf raises:

[jira] [Updated] (SPARK-23569) pandas_udf does not work with type-annotated python functions

[ https://issues.apache.org/jira/browse/SPARK-23569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stu (Michael Stewart) updated SPARK-23569: -- Description: When invoked against a type annotated function pandas_udf raises:

[jira] [Created] (SPARK-23570) Use 2.3 in HiveExternalCatalogVersionsSuite

Xiao Li created SPARK-23570: --- Summary: Use 2.3 in HiveExternalCatalogVersionsSuite Key: SPARK-23570 URL: https://issues.apache.org/jira/browse/SPARK-23570 Project: Spark Issue Type: Bug C

[jira] [Updated] (SPARK-23570) Add Spark-2.3 in HiveExternalCatalogVersionsSuite

[ https://issues.apache.org/jira/browse/SPARK-23570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23570: Summary: Add Spark-2.3 in HiveExternalCatalogVersionsSuite (was: Use 2.3 in HiveExternalCatalogVersionsSui

[jira] [Assigned] (SPARK-23570) Add Spark-2.3 in HiveExternalCatalogVersionsSuite

[ https://issues.apache.org/jira/browse/SPARK-23570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23570: Assignee: Xiao Li (was: Apache Spark) > Add Spark-2.3 in HiveExternalCatalogVersionsSuite

[jira] [Commented] (SPARK-23570) Add Spark-2.3 in HiveExternalCatalogVersionsSuite

[ https://issues.apache.org/jira/browse/SPARK-23570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384027#comment-16384027 ] Apache Spark commented on SPARK-23570: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-23570) Add Spark-2.3 in HiveExternalCatalogVersionsSuite

[ https://issues.apache.org/jira/browse/SPARK-23570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23570: Assignee: Apache Spark (was: Xiao Li) > Add Spark-2.3 in HiveExternalCatalogVersionsSuite

[jira] [Created] (SPARK-23571) Delete auxiliary Kubernetes resources upon application completion

Yinan Li created SPARK-23571: Summary: Delete auxiliary Kubernetes resources upon application completion Key: SPARK-23571 URL: https://issues.apache.org/jira/browse/SPARK-23571 Project: Spark Is

[jira] [Commented] (SPARK-18673) Dataframes doesn't work on Hadoop 3.x; Hive rejects Hadoop version

[ https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384044#comment-16384044 ] Aihua Xu commented on SPARK-18673: -- [~jerryshao] We only need HIVE-15016 and HIVE-18550

[jira] [Created] (SPARK-23572) Update security.md to cover new features

Marcelo Vanzin created SPARK-23572: -- Summary: Update security.md to cover new features Key: SPARK-23572 URL: https://issues.apache.org/jira/browse/SPARK-23572 Project: Spark Issue Type: Impr

[jira] [Updated] (SPARK-23571) Delete auxiliary Kubernetes resources upon application completion

[ https://issues.apache.org/jira/browse/SPARK-23571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yinan Li updated SPARK-23571: - Affects Version/s: 2.3.1 > Delete auxiliary Kubernetes resources upon application completion > --

[jira] [Commented] (SPARK-23572) Update security.md to cover new features

[ https://issues.apache.org/jira/browse/SPARK-23572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384077#comment-16384077 ] Marcelo Vanzin commented on SPARK-23572: As an addendum, there is quite a lot of

[jira] [Commented] (SPARK-22446) Optimizer causing StringIndexerModel's indexer UDF to throw "Unseen label" exception incorrectly for filtered data.

[ https://issues.apache.org/jira/browse/SPARK-22446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384078#comment-16384078 ] Joseph K. Bradley commented on SPARK-22446: --- I see. Do you have a sense of how

[jira] [Updated] (SPARK-23569) pandas_udf does not work with type-annotated python functions

[ https://issues.apache.org/jira/browse/SPARK-23569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stu (Michael Stewart) updated SPARK-23569: -- Description: When invoked against a type annotated function pandas_udf raises:

[jira] [Commented] (SPARK-23571) Delete auxiliary Kubernetes resources upon application completion

[ https://issues.apache.org/jira/browse/SPARK-23571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384090#comment-16384090 ] Apache Spark commented on SPARK-23571: -- User 'liyinan926' has created a pull request

[jira] [Assigned] (SPARK-23571) Delete auxiliary Kubernetes resources upon application completion

[ https://issues.apache.org/jira/browse/SPARK-23571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23571: Assignee: (was: Apache Spark) > Delete auxiliary Kubernetes resources upon application

[jira] [Assigned] (SPARK-23571) Delete auxiliary Kubernetes resources upon application completion

[ https://issues.apache.org/jira/browse/SPARK-23571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23571: Assignee: Apache Spark > Delete auxiliary Kubernetes resources upon application completion

[jira] [Resolved] (SPARK-23097) Migrate text socket source to v2

[ https://issues.apache.org/jira/browse/SPARK-23097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-23097. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 20382 [https://g

[jira] [Commented] (SPARK-23549) Spark SQL unexpected behavior when comparing timestamp to date

[ https://issues.apache.org/jira/browse/SPARK-23549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384226#comment-16384226 ] Dong Jiang commented on SPARK-23549: Tested in spark 2.3.0, same thing > Spark SQL u

[jira] [Assigned] (SPARK-23538) Simplify SSL configuration for https client

[ https://issues.apache.org/jira/browse/SPARK-23538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23538: Assignee: Apache Spark > Simplify SSL configuration for https client > ---

[jira] [Assigned] (SPARK-23538) Simplify SSL configuration for https client

[ https://issues.apache.org/jira/browse/SPARK-23538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23538: Assignee: (was: Apache Spark) > Simplify SSL configuration for https client >

[jira] [Commented] (SPARK-23538) Simplify SSL configuration for https client

[ https://issues.apache.org/jira/browse/SPARK-23538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384248#comment-16384248 ] Apache Spark commented on SPARK-23538: -- User 'vanzin' has created a pull request for

[jira] [Resolved] (SPARK-23570) Add Spark-2.3 in HiveExternalCatalogVersionsSuite

[ https://issues.apache.org/jira/browse/SPARK-23570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23570. - Resolution: Fixed Fix Version/s: 2.4.0 2.3.1 > Add Spark-2.3 in HiveExternalCat

[jira] [Assigned] (SPARK-18630) PySpark ML memory leak

[ https://issues.apache.org/jira/browse/SPARK-18630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18630: Assignee: (was: Apache Spark) > PySpark ML memory leak > -- > >

[jira] [Commented] (SPARK-18630) PySpark ML memory leak

[ https://issues.apache.org/jira/browse/SPARK-18630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384368#comment-16384368 ] Apache Spark commented on SPARK-18630: -- User 'yogeshg' has created a pull request fo

[jira] [Assigned] (SPARK-18630) PySpark ML memory leak

[ https://issues.apache.org/jira/browse/SPARK-18630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18630: Assignee: Apache Spark > PySpark ML memory leak > -- > >

[jira] [Assigned] (SPARK-23555) Add BinaryType support for Arrow in PySpark

[ https://issues.apache.org/jira/browse/SPARK-23555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23555: Assignee: Apache Spark > Add BinaryType support for Arrow in PySpark > ---

[jira] [Assigned] (SPARK-23555) Add BinaryType support for Arrow in PySpark

[ https://issues.apache.org/jira/browse/SPARK-23555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23555: Assignee: (was: Apache Spark) > Add BinaryType support for Arrow in PySpark >

[jira] [Commented] (SPARK-23555) Add BinaryType support for Arrow in PySpark

[ https://issues.apache.org/jira/browse/SPARK-23555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384369#comment-16384369 ] Apache Spark commented on SPARK-23555: -- User 'BryanCutler' has created a pull reques

[jira] [Resolved] (SPARK-3159) Check for reducible DecisionTree

[ https://issues.apache.org/jira/browse/SPARK-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Seth Hendrickson resolved SPARK-3159. - Resolution: Fixed Fix Version/s: 2.4.0 > Check for reducible DecisionTree > ---

[jira] [Created] (SPARK-23573) Ban the usage of SparkContext.hadoopConfiguration

Xiao Li created SPARK-23573: --- Summary: Ban the usage of SparkContext.hadoopConfiguration Key: SPARK-23573 URL: https://issues.apache.org/jira/browse/SPARK-23573 Project: Spark Issue Type: Improveme

[jira] [Updated] (SPARK-23573) Create linter rule to prevent misuse of SparkContext.hadoopConfiguration in SQL modules

[ https://issues.apache.org/jira/browse/SPARK-23573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23573: Summary: Create linter rule to prevent misuse of SparkContext.hadoopConfiguration in SQL modules (was: Ban

[jira] [Commented] (SPARK-18492) GeneratedIterator grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384428#comment-16384428 ] Kazuaki Ishizaki commented on SPARK-18492: -- Thanks, what is the definition of {{

[jira] [Comment Edited] (SPARK-18492) GeneratedIterator grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384428#comment-16384428 ] Kazuaki Ishizaki edited comment on SPARK-18492 at 3/3/18 2:08 AM: -

[jira] [Resolved] (SPARK-23541) Allow Kafka source to read data with greater parallelism than the number of topic-partitions

[ https://issues.apache.org/jira/browse/SPARK-23541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-23541. --- Resolution: Fixed Fix Version/s: 2.4.0 > Allow Kafka source to read data with greater

[jira] [Created] (SPARK-23574) SinglePartition in data source V2 scan

Jose Torres created SPARK-23574: --- Summary: SinglePartition in data source V2 scan Key: SPARK-23574 URL: https://issues.apache.org/jira/browse/SPARK-23574 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-23574) SinglePartition in data source V2 scan

[ https://issues.apache.org/jira/browse/SPARK-23574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23574: Assignee: (was: Apache Spark) > SinglePartition in data source V2 scan > -

[jira] [Commented] (SPARK-23574) SinglePartition in data source V2 scan

[ https://issues.apache.org/jira/browse/SPARK-23574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384475#comment-16384475 ] Apache Spark commented on SPARK-23574: -- User 'jose-torres' has created a pull reques

[jira] [Assigned] (SPARK-23574) SinglePartition in data source V2 scan

[ https://issues.apache.org/jira/browse/SPARK-23574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23574: Assignee: Apache Spark > SinglePartition in data source V2 scan >

[jira] [Updated] (SPARK-23574) SinglePartition in data source V2 scan

[ https://issues.apache.org/jira/browse/SPARK-23574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Torres updated SPARK-23574: Component/s: (was: Structured Streaming) Spark Core > SinglePartition in data

[jira] [Created] (SPARK-23575) ERROR RetryingHMSHandler:159 - AlreadyExistsException(message:

Carlos Sanchez created SPARK-23575: -- Summary: ERROR RetryingHMSHandler:159 - AlreadyExistsException(message: Key: SPARK-23575 URL: https://issues.apache.org/jira/browse/SPARK-23575 Project: Spark

[jira] [Updated] (SPARK-23575) ERROR RetryingHMSHandler:159 - AlreadyExistsException(message:

[ https://issues.apache.org/jira/browse/SPARK-23575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlos Sanchez updated SPARK-23575: --- Description: It seems this issue is back (regression, https://issues.apache.org/jira/browse/

[jira] [Created] (SPARK-23576) SparkSQL - Decimal data missing decimal point

R created SPARK-23576: - Summary: SparkSQL - Decimal data missing decimal point Key: SPARK-23576 URL: https://issues.apache.org/jira/browse/SPARK-23576 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 1.1.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384488#comment-16384488 ] Richard Yu commented on SPARK-18057: [~sliebau]  Hi, I'm interested in participating