[jira] [Commented] (SPARK-30670) Pipes for PySpark

2020-01-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027244#comment-17027244 ] Hyukjin Kwon commented on SPARK-30670: -- Yes, it's intentional in order to match it with Scala side.

[jira] [Resolved] (SPARK-30671) SparkSession emptyDataFrame should not create an RDD

2020-01-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30671. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27400

[jira] [Commented] (SPARK-30670) Pipes for PySpark

2020-01-30 Thread Vincent (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027242#comment-17027242 ] Vincent commented on SPARK-30670: - I just had a look, but transform does not allow for `*args` and

[jira] [Commented] (SPARK-26449) Missing Dataframe.transform API in Python API

2020-01-30 Thread Vincent (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027241#comment-17027241 ] Vincent commented on SPARK-26449: - Is there a reason why transform does not accept `*args` and

[jira] [Created] (SPARK-30690) Expose the documentation of CalendarInternval in API documentation

2020-01-30 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-30690: Summary: Expose the documentation of CalendarInternval in API documentation Key: SPARK-30690 URL: https://issues.apache.org/jira/browse/SPARK-30690 Project: Spark

[jira] [Updated] (SPARK-30065) Unable to drop na with duplicate columns

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30065: -- Fix Version/s: 2.4.5 > Unable to drop na with duplicate columns >

[jira] [Commented] (SPARK-30065) Unable to drop na with duplicate columns

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027239#comment-17027239 ] Dongjoon Hyun commented on SPARK-30065: --- This is backported to `branch-2.4` via

[jira] [Resolved] (SPARK-30669) Introduce AdmissionControl API to Structured Streaming

2020-01-30 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-30669. - Fix Version/s: 3.0.0 Assignee: Burak Yavuz Resolution: Done Resolved by 

[jira] [Assigned] (SPARK-30362) InputMetrics are not updated for DataSourceRDD V2

2020-01-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30362: --- Assignee: Sandeep Katta > InputMetrics are not updated for DataSourceRDD V2 >

[jira] [Resolved] (SPARK-30362) InputMetrics are not updated for DataSourceRDD V2

2020-01-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30362. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27021

[jira] [Resolved] (SPARK-29665) refine the TableProvider interface

2020-01-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29665. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26868

[jira] [Commented] (SPARK-26021) -0.0 and 0.0 not treated consistently, doesn't match Hive

2020-01-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027180#comment-17027180 ] Wenchen Fan commented on SPARK-26021: - FYI: This fix has been replaced by a better fix that retains

[jira] [Resolved] (SPARK-29438) Failed to get state store in stream-stream join

2020-01-30 Thread Tathagata Das (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-29438. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26162

[jira] [Assigned] (SPARK-29438) Failed to get state store in stream-stream join

2020-01-30 Thread Tathagata Das (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reassigned SPARK-29438: - Assignee: Jungtaek Lim > Failed to get state store in stream-stream join >

[jira] [Resolved] (SPARK-30656) Support the "minPartitions" option in Kafka batch source and streaming source v1

2020-01-30 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-30656. -- Fix Version/s: 3.0.0 Resolution: Done > Support the "minPartitions" option in Kafka

[jira] [Updated] (SPARK-29890) Unable to fill na with 0 with duplicate columns

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29890: -- Fix Version/s: 2.4.5 > Unable to fill na with 0 with duplicate columns >

[jira] [Updated] (SPARK-30689) Allow custom resource scheduling to work with YARN versions that don't support custom resource scheduling

2020-01-30 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-30689: -- Description: Many people/companies will not be moving to Hadoop 3.1 or greater, where it

[jira] [Updated] (SPARK-30689) Allow custom resource scheduling to work with YARN versions that don't support custom resource scheduling

2020-01-30 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-30689: -- Description: Many people/companies will not be moving to Hadoop 3.1 or greater, where it

[jira] [Updated] (SPARK-30689) Allow custom resource scheduling to work with YARN versions that don't support custom resource scheduling

2020-01-30 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-30689: -- Issue Type: Improvement (was: Bug) > Allow custom resource scheduling to work with YARN

[jira] [Created] (SPARK-30689) Allow custom resource scheduling to work with Hadoop versions that don't support it

2020-01-30 Thread Thomas Graves (Jira)
Thomas Graves created SPARK-30689: - Summary: Allow custom resource scheduling to work with Hadoop versions that don't support it Key: SPARK-30689 URL: https://issues.apache.org/jira/browse/SPARK-30689

[jira] [Updated] (SPARK-30689) Allow custom resource scheduling to work with YARN versions that don't support custom resource scheduling

2020-01-30 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-30689: -- Summary: Allow custom resource scheduling to work with YARN versions that don't support

[jira] [Created] (SPARK-30688) Spark SQL Unix Timestamp produces incorrect result with unix_timestamp UDF

2020-01-30 Thread Rajkumar Singh (Jira)
Rajkumar Singh created SPARK-30688: -- Summary: Spark SQL Unix Timestamp produces incorrect result with unix_timestamp UDF Key: SPARK-30688 URL: https://issues.apache.org/jira/browse/SPARK-30688

[jira] [Created] (SPARK-30687) When reading from a file with pre-defined schema and encountering a single value that is not the same type as that of its column , Spark nullifies the entire row

2020-01-30 Thread Bao Nguyen (Jira)
Bao Nguyen created SPARK-30687: -- Summary: When reading from a file with pre-defined schema and encountering a single value that is not the same type as that of its column , Spark nullifies the entire row Key: SPARK-30687

[jira] [Updated] (SPARK-30065) Unable to drop na with duplicate columns

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30065: -- Affects Version/s: 2.0.2 > Unable to drop na with duplicate columns >

[jira] [Updated] (SPARK-30065) Unable to drop na with duplicate columns

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30065: -- Affects Version/s: 2.1.3 > Unable to drop na with duplicate columns >

[jira] [Updated] (SPARK-30065) Unable to drop na with duplicate columns

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30065: -- Affects Version/s: 2.2.3 2.3.4 2.4.4 > Unable

[jira] [Updated] (SPARK-29890) Unable to fill na with 0 with duplicate columns

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29890: -- Affects Version/s: 2.0.2 > Unable to fill na with 0 with duplicate columns >

[jira] [Updated] (SPARK-29890) Unable to fill na with 0 with duplicate columns

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29890: -- Affects Version/s: 2.1.3 > Unable to fill na with 0 with duplicate columns >

[jira] [Updated] (SPARK-29890) Unable to fill na with 0 with duplicate columns

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29890: -- Affects Version/s: 2.2.3 > Unable to fill na with 0 with duplicate columns >

[jira] [Updated] (SPARK-30065) Unable to drop na with duplicate columns

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30065: -- Issue Type: Bug (was: Improvement) > Unable to drop na with duplicate columns >

[jira] [Updated] (SPARK-30638) add resources as parameter to the PluginContext

2020-01-30 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-30638: -- Description: Add the allocates resources to parameters to the PluginContext so that any

[jira] [Resolved] (SPARK-30673) Test cases in HiveShowCreateTableSuite should create Hive table instead of Datasource table

2020-01-30 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-30673. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27393

[jira] [Commented] (SPARK-21823) ALTER TABLE table statements such as RENAME and CHANGE columns should raise error if there are any dependent constraints.

2020-01-30 Thread Sunitha Kambhampati (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026944#comment-17026944 ] Sunitha Kambhampati commented on SPARK-21823: - This issue is as part of the new

[jira] [Assigned] (SPARK-30662) ALS/MLP extend HasBlockSize

2020-01-30 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-30662: Assignee: Huaxin Gao > ALS/MLP extend HasBlockSize > --- > >

[jira] [Resolved] (SPARK-30662) ALS/MLP extend HasBlockSize

2020-01-30 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30662. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27389

[jira] [Commented] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

2020-01-30 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026936#comment-17026936 ] Sean R. Owen commented on SPARK-29292: -- Right, I agree. I can try updating my fork and pushing the

[jira] [Commented] (SPARK-30686) Spark 2.4.4 metrics endpoint throwing error

2020-01-30 Thread Behroz Sikander (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026929#comment-17026929 ] Behroz Sikander commented on SPARK-30686: - 1- I don't know the exact steps, i tried to reproduce

[jira] [Commented] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

2020-01-30 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026914#comment-17026914 ] Kousuke Saruta commented on SPARK-29292: I was about to try to work on this so I've confirmed. I

[jira] [Resolved] (SPARK-30680) ResolvedNamespace does not require a namespace catalog

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30680. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27403

[jira] [Resolved] (SPARK-30622) commands should return dummy statistics

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30622. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27344

[jira] [Updated] (SPARK-29639) Spark Kafka connector 0.10.0 generates incorrect end offsets for micro batch

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29639: -- Target Version/s: (was: 2.4.4, 2.4.5) > Spark Kafka connector 0.10.0 generates incorrect

[jira] [Commented] (SPARK-30686) Spark 2.4.4 metrics endpoint throwing error

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026886#comment-17026886 ] Dongjoon Hyun commented on SPARK-30686: --- Hi, [~bsikander]. Thank you for reporting. # Could you

[jira] [Updated] (SPARK-30685) Support ANSI INSERT syntax

2020-01-30 Thread Chris Knoll (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Knoll updated SPARK-30685: Issue Type: New Feature (was: Bug) > Support ANSI INSERT syntax > -- > >

[jira] [Assigned] (SPARK-30678) Eliminate warnings from deprecated BisectingKMeansModel.computeCost

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30678: - Assignee: Maxim Gekk > Eliminate warnings from deprecated

[jira] [Resolved] (SPARK-30678) Eliminate warnings from deprecated BisectingKMeansModel.computeCost

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30678. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27401

[jira] [Resolved] (SPARK-30659) LogisticRegression blockify input vectors

2020-01-30 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30659. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27374

[jira] [Commented] (SPARK-30686) Spark 2.4.4 metrics endpoint throwing error

2020-01-30 Thread Behroz Sikander (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026805#comment-17026805 ] Behroz Sikander commented on SPARK-30686: - Sometimes, I have also seen {code:java} Caused by:

[jira] [Created] (SPARK-30686) Spark 2.4.4 metrics endpoint throwing error

2020-01-30 Thread Behroz Sikander (Jira)
Behroz Sikander created SPARK-30686: --- Summary: Spark 2.4.4 metrics endpoint throwing error Key: SPARK-30686 URL: https://issues.apache.org/jira/browse/SPARK-30686 Project: Spark Issue

[jira] [Created] (SPARK-30685) Support ANSI INSERT syntax

2020-01-30 Thread Chris Knoll (Jira)
Chris Knoll created SPARK-30685: --- Summary: Support ANSI INSERT syntax Key: SPARK-30685 URL: https://issues.apache.org/jira/browse/SPARK-30685 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-30684) Show the descripton of metrics for WholeStageCodegen in DAG viz

2020-01-30 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-30684: -- Summary: Show the descripton of metrics for WholeStageCodegen in DAG viz Key: SPARK-30684 URL: https://issues.apache.org/jira/browse/SPARK-30684 Project: Spark

[jira] [Commented] (SPARK-30683) Validating sha512 files for releases does not comply with Apache Project documentation

2020-01-30 Thread Loki Coyote (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026785#comment-17026785 ] Loki Coyote commented on SPARK-30683: - This command seems like it would work for conversion and

[jira] [Updated] (SPARK-30683) Validating sha512 files for releases does not comply with Apache Project documentation

2020-01-30 Thread Nick Jacobsen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Jacobsen updated SPARK-30683: -- Description: Spark release artifacts currently use gpg generated sha512 files.  These are

[jira] [Updated] (SPARK-30683) Validating sha512 files for releases does not comply with Apache Project documentation

2020-01-30 Thread Nick Jacobsen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Jacobsen updated SPARK-30683: -- Description: Spark release artifacts currently use gpg generated sha512 files.  These are

[jira] [Created] (SPARK-30683) Validating sha512 files for releases does not comply with Apache Project documentation

2020-01-30 Thread Nick Jacobsen (Jira)
Nick Jacobsen created SPARK-30683: - Summary: Validating sha512 files for releases does not comply with Apache Project documentation Key: SPARK-30683 URL: https://issues.apache.org/jira/browse/SPARK-30683

[jira] [Updated] (SPARK-30681) Add higher order functions API to PySpark

2020-01-30 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-30681: --- Description: As of 3.0.0 higher order functions are available in SQL and Scala, but

[jira] [Created] (SPARK-30682) Add higher order functions API to SparkR

2020-01-30 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30682: -- Summary: Add higher order functions API to SparkR Key: SPARK-30682 URL: https://issues.apache.org/jira/browse/SPARK-30682 Project: Spark Issue

[jira] [Created] (SPARK-30681) Add higher order functions API to PySpark

2020-01-30 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30681: -- Summary: Add higher order functions API to PySpark Key: SPARK-30681 URL: https://issues.apache.org/jira/browse/SPARK-30681 Project: Spark Issue

[jira] [Created] (SPARK-30680) ResolvedNamespace does not require a namespace catalog

2020-01-30 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-30680: --- Summary: ResolvedNamespace does not require a namespace catalog Key: SPARK-30680 URL: https://issues.apache.org/jira/browse/SPARK-30680 Project: Spark Issue

[jira] [Commented] (SPARK-30619) org.slf4j.Logger and org.apache.commons.collections classes not built as part of hadoop-provided profile

2020-01-30 Thread Abhishek Rao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026612#comment-17026612 ] Abhishek Rao commented on SPARK-30619: -- Here are the 2 exceptions SLF4J: Error: A JNI error has

[jira] [Created] (SPARK-30679) REPLACE TABLE can omit the USING clause

2020-01-30 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-30679: --- Summary: REPLACE TABLE can omit the USING clause Key: SPARK-30679 URL: https://issues.apache.org/jira/browse/SPARK-30679 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-30674) Use python3 in dev/lint-python

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30674. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27394

[jira] [Assigned] (SPARK-30674) Use python3 in dev/lint-python

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30674: - Assignee: Dongjoon Hyun > Use python3 in dev/lint-python >

[jira] [Updated] (SPARK-30678) Eliminate warnings from deprecated BisectingKMeansModel.computeCost

2020-01-30 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30678: --- Component/s: (was: SQL) MLlib > Eliminate warnings from deprecated

[jira] [Created] (SPARK-30678) Eliminate warnings from deprecated BisectingKMeansModel.computeCost

2020-01-30 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30678: -- Summary: Eliminate warnings from deprecated BisectingKMeansModel.computeCost Key: SPARK-30678 URL: https://issues.apache.org/jira/browse/SPARK-30678 Project: Spark

[jira] [Closed] (SPARK-28897) Invalid usage of '*' in expression 'coalesce' error when executing dataframe.na.fill(0)

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-28897. - > Invalid usage of '*' in expression 'coalesce' error when executing > dataframe.na.fill(0) >

[jira] [Resolved] (SPARK-28897) Invalid usage of '*' in expression 'coalesce' error when executing dataframe.na.fill(0)

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28897. --- Resolution: Duplicate > Invalid usage of '*' in expression 'coalesce' error when executing

[jira] [Commented] (SPARK-12312) JDBC connection to Kerberos secured databases fails on remote executors

2020-01-30 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026554#comment-17026554 ] Gabor Somogyi commented on SPARK-12312: --- [~quarkonium] As an initial step the PR what I'm working

[jira] [Commented] (SPARK-30667) Support simple all gather in barrier task context

2020-01-30 Thread Sarth Frey (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026545#comment-17026545 ] Sarth Frey commented on SPARK-30667: [https://github.com/apache/spark/pull/27395] > Support simple

[jira] [Updated] (SPARK-29670) Make executor's bindAddress configurable

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29670: -- Fix Version/s: (was: 3.0.0) > Make executor's bindAddress configurable >

[jira] [Closed] (SPARK-29670) Make executor's bindAddress configurable

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-29670. - > Make executor's bindAddress configurable > > >

[jira] [Updated] (SPARK-24203) Make executor's bindAddress configurable

2020-01-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24203: -- Labels: (was: bulk-closed) > Make executor's bindAddress configurable >

[jira] [Updated] (SPARK-30677) Spark Streaming Job stuck when Kinesis Shard is increased when the job is running

2020-01-30 Thread Mullaivendhan Ariaputhri (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mullaivendhan Ariaputhri updated SPARK-30677: - Attachment: Cluster-Config-P1.JPG Instance-Config-P2.JPG

[jira] [Updated] (SPARK-30677) Spark Streaming Job stuck when Kinesis Shard is increased when the job is running

2020-01-30 Thread Mullaivendhan Ariaputhri (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mullaivendhan Ariaputhri updated SPARK-30677: - Description: Spark job stopped processing when the number of shards is

[jira] [Created] (SPARK-30677) Spark Streaming Job stuck when Kinesis Shard is increased when the job is running

2020-01-30 Thread Mullaivendhan Ariaputhri (Jira)
Mullaivendhan Ariaputhri created SPARK-30677: Summary: Spark Streaming Job stuck when Kinesis Shard is increased when the job is running Key: SPARK-30677 URL:

[jira] [Created] (SPARK-30676) Eliminate warnings from deprecated constructors of java.lang.Integer and java.lang.Double

2020-01-30 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30676: -- Summary: Eliminate warnings from deprecated constructors of java.lang.Integer and java.lang.Double Key: SPARK-30676 URL: https://issues.apache.org/jira/browse/SPARK-30676