[jira] [Updated] (SPARK-25040) Empty string should be disallowed for data types except for string and binary types in JSON

[ https://issues.apache.org/jira/browse/SPARK-25040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-25040: Summary: Empty string should be disallowed for data types except for string and binary

[jira] [Created] (SPARK-25806) The instanceof FileSplit is redundant for ParquetFileFormat

liuxian created SPARK-25806: --- Summary: The instanceof FileSplit is redundant for ParquetFileFormat Key: SPARK-25806 URL: https://issues.apache.org/jira/browse/SPARK-25806 Project: Spark Issue

[jira] [Updated] (SPARK-25806) The instanceof FileSplit is redundant for ParquetFileFormat

[ https://issues.apache.org/jira/browse/SPARK-25806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-25806: Description: The instanceof FileSplit is redundant for {color:#ffc66d}buildReaderWithPartitionValues

[jira] [Updated] (SPARK-25806) The instanceof FileSplit is redundant for ParquetFileFormat

[ https://issues.apache.org/jira/browse/SPARK-25806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-25806: Description: The instanceof FileSplit is redundant for {color:#ffc66d}buildReaderWithPartitionValues

[jira] [Updated] (SPARK-25806) The instanceof FileSplit is redundant for ParquetFileFormat

[ https://issues.apache.org/jira/browse/SPARK-25806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-25806: Description: The instanceof FileSplit is redundant for {color:#ffc66d}buildReaderWithPartitionValues

[jira] [Assigned] (SPARK-25806) The instanceof FileSplit is redundant for ParquetFileFormat

[ https://issues.apache.org/jira/browse/SPARK-25806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25806: Assignee: (was: Apache Spark) > The instanceof FileSplit is redundant for

[jira] [Resolved] (SPARK-25796) Enable external shuffle service for kubernetes mode.

[ https://issues.apache.org/jira/browse/SPARK-25796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-25796. - Resolution: Duplicate > Enable external shuffle service for kubernetes mode. >

[jira] [Updated] (SPARK-25040) Empty string should be disallowed for data types other than string and binary in JSON

[ https://issues.apache.org/jira/browse/SPARK-25040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-25040: Summary: Empty string should be disallowed for data types other than string and binary in

[jira] [Commented] (SPARK-25040) Empty string should be disallowed for data types except for string and binary types in JSON

[ https://issues.apache.org/jira/browse/SPARK-25040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660143#comment-16660143 ] Liang-Chi Hsieh commented on SPARK-25040: - The JIRA title is not correct now. I changed it. >

[jira] [Updated] (SPARK-25806) The instanceof FileSplit is redundant for ParquetFileFormat

[ https://issues.apache.org/jira/browse/SPARK-25806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-25806: Description: The instance of FileSplit is redundant for {color:#ffc66d}buildReaderWithPartitionValues

[jira] [Assigned] (SPARK-25806) The instanceof FileSplit is redundant for ParquetFileFormat

[ https://issues.apache.org/jira/browse/SPARK-25806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25806: Assignee: Apache Spark > The instanceof FileSplit is redundant for ParquetFileFormat >

[jira] [Commented] (SPARK-25806) The instanceof FileSplit is redundant for ParquetFileFormat

[ https://issues.apache.org/jira/browse/SPARK-25806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660185#comment-16660185 ] Apache Spark commented on SPARK-25806: -- User '10110346' has created a pull request for this issue:

[jira] [Created] (SPARK-25807) Mitigate 1-based substr() confusion

Oron Navon created SPARK-25807: -- Summary: Mitigate 1-based substr() confusion Key: SPARK-25807 URL: https://issues.apache.org/jira/browse/SPARK-25807 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-25808) upgrade jsr305 version from 1.3.9 to 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-25808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660380#comment-16660380 ] Apache Spark commented on SPARK-25808: -- User 'daviddingly' has created a pull request for this

[jira] [Assigned] (SPARK-25808) upgrade jsr305 version from 1.3.9 to 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-25808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25808: Assignee: Apache Spark > upgrade jsr305 version from 1.3.9 to 3.0.0 >

[jira] [Created] (SPARK-25809) Support additional K8S cluster types for integration tests

Rob Vesse created SPARK-25809: - Summary: Support additional K8S cluster types for integration tests Key: SPARK-25809 URL: https://issues.apache.org/jira/browse/SPARK-25809 Project: Spark Issue

[jira] [Commented] (SPARK-25801) pandas_udf grouped_map fails with input dataframe with more than 255 columns

[ https://issues.apache.org/jira/browse/SPARK-25801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660360#comment-16660360 ] Frederik commented on SPARK-25801: -- Hi Bryan, Thanks for the quick answer! I wasn't aware Python 3.7

[jira] [Resolved] (SPARK-25805) Flaky test: DataFrameSuite.SPARK-25159 unittest failure

[ https://issues.apache.org/jira/browse/SPARK-25805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25805. - Resolution: Fixed Fix Version/s: 3.0.0 2.4.1 Issue resolved by pull

[jira] [Assigned] (SPARK-25805) Flaky test: DataFrameSuite.SPARK-25159 unittest failure

[ https://issues.apache.org/jira/browse/SPARK-25805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-25805: --- Assignee: Imran Rashid > Flaky test: DataFrameSuite.SPARK-25159 unittest failure >

[jira] [Commented] (SPARK-25808) upgrade jsr305 version from 1.3.9 to 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-25808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660381#comment-16660381 ] Apache Spark commented on SPARK-25808: -- User 'daviddingly' has created a pull request for this

[jira] [Assigned] (SPARK-25808) upgrade jsr305 version from 1.3.9 to 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-25808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25808: Assignee: (was: Apache Spark) > upgrade jsr305 version from 1.3.9 to 3.0.0 >

[jira] [Commented] (SPARK-25665) Refactor ObjectHashAggregateExecBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660290#comment-16660290 ] Apache Spark commented on SPARK-25665: -- User 'peter-toth' has created a pull request for this

[jira] [Commented] (SPARK-25665) Refactor ObjectHashAggregateExecBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660291#comment-16660291 ] Apache Spark commented on SPARK-25665: -- User 'peter-toth' has created a pull request for this

[jira] [Created] (SPARK-25808) upgrade jsr305 version from 1.3.9 to 3.0.0

ding xiaoyuan created SPARK-25808: - Summary: upgrade jsr305 version from 1.3.9 to 3.0.0 Key: SPARK-25808 URL: https://issues.apache.org/jira/browse/SPARK-25808 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-25809) Support additional K8S cluster types for integration tests

[ https://issues.apache.org/jira/browse/SPARK-25809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25809: Assignee: (was: Apache Spark) > Support additional K8S cluster types for integration

[jira] [Commented] (SPARK-25809) Support additional K8S cluster types for integration tests

[ https://issues.apache.org/jira/browse/SPARK-25809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660641#comment-16660641 ] Apache Spark commented on SPARK-25809: -- User 'rvesse' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25809) Support additional K8S cluster types for integration tests

[ https://issues.apache.org/jira/browse/SPARK-25809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25809: Assignee: Apache Spark > Support additional K8S cluster types for integration tests >

[jira] [Assigned] (SPARK-25665) Refactor ObjectHashAggregateExecBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25665: Assignee: Apache Spark > Refactor ObjectHashAggregateExecBenchmark to use main method >

[jira] [Assigned] (SPARK-25665) Refactor ObjectHashAggregateExecBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25665: Assignee: (was: Apache Spark) > Refactor ObjectHashAggregateExecBenchmark to use

[jira] [Commented] (SPARK-25675) [Spark Job History] Job UI page does not show pagination with one page

[ https://issues.apache.org/jira/browse/SPARK-25675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660918#comment-16660918 ] Apache Spark commented on SPARK-25675: -- User 'gengliangwang' has created a pull request for this

[jira] [Updated] (SPARK-25812) Flaky test: PagedTableSuite.pageNavigation

[ https://issues.apache.org/jira/browse/SPARK-25812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25812: -- Description: -

[jira] [Commented] (SPARK-25811) Support PyArrow's feature to raise an error for unsafe cast

[ https://issues.apache.org/jira/browse/SPARK-25811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660807#comment-16660807 ] Apache Spark commented on SPARK-25811: -- User 'viirya' has created a pull request for this issue:

[jira] [Resolved] (SPARK-25791) Datatype of serializers in RowEncoder should be accessible

[ https://issues.apache.org/jira/browse/SPARK-25791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25791. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22785

[jira] [Assigned] (SPARK-25791) Datatype of serializers in RowEncoder should be accessible

[ https://issues.apache.org/jira/browse/SPARK-25791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-25791: --- Assignee: Liang-Chi Hsieh > Datatype of serializers in RowEncoder should be accessible >

[jira] [Created] (SPARK-25810) Spark structured streaming logs auto.offset.reset=earliest even though startingOffsets is set to latest

ANUJA BANTHIYA created SPARK-25810: -- Summary: Spark structured streaming logs auto.offset.reset=earliest even though startingOffsets is set to latest Key: SPARK-25810 URL:

[jira] [Assigned] (SPARK-25250) Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multiple tim

[ https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25250: Assignee: (was: Apache Spark) > Race condition with tasks running when new attempt

[jira] [Commented] (SPARK-25250) Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multiple ti

[ https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660746#comment-16660746 ] Apache Spark commented on SPARK-25250: -- User 'pgandhi999' has created a pull request for this

[jira] [Assigned] (SPARK-25250) Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multiple tim

[ https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25250: Assignee: Apache Spark > Race condition with tasks running when new attempt for same

[jira] [Commented] (SPARK-25250) Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multiple ti

[ https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660744#comment-16660744 ] Apache Spark commented on SPARK-25250: -- User 'pgandhi999' has created a pull request for this

[jira] [Created] (SPARK-25812) Flaky test: PagedTableSuite.pageNavigation

Dongjoon Hyun created SPARK-25812: - Summary: Flaky test: PagedTableSuite.pageNavigation Key: SPARK-25812 URL: https://issues.apache.org/jira/browse/SPARK-25812 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-25811) Support PyArrow's feature to raise an error for unsafe cast

[ https://issues.apache.org/jira/browse/SPARK-25811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25811: Assignee: (was: Apache Spark) > Support PyArrow's feature to raise an error for

[jira] [Assigned] (SPARK-25811) Support PyArrow's feature to raise an error for unsafe cast

[ https://issues.apache.org/jira/browse/SPARK-25811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25811: Assignee: Apache Spark > Support PyArrow's feature to raise an error for unsafe cast >

[jira] [Commented] (SPARK-25811) Support PyArrow's feature to raise an error for unsafe cast

[ https://issues.apache.org/jira/browse/SPARK-25811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660803#comment-16660803 ] Apache Spark commented on SPARK-25811: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-25675) [Spark Job History] Job UI page does not show pagination with one page

[ https://issues.apache.org/jira/browse/SPARK-25675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660914#comment-16660914 ] Apache Spark commented on SPARK-25675: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-25812) Flaky test: PagedTableSuite.pageNavigation

[ https://issues.apache.org/jira/browse/SPARK-25812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25812: Assignee: (was: Apache Spark) > Flaky test: PagedTableSuite.pageNavigation >

[jira] [Commented] (SPARK-25812) Flaky test: PagedTableSuite.pageNavigation

[ https://issues.apache.org/jira/browse/SPARK-25812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660959#comment-16660959 ] Apache Spark commented on SPARK-25812: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-25812) Flaky test: PagedTableSuite.pageNavigation

[ https://issues.apache.org/jira/browse/SPARK-25812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25812: Assignee: Apache Spark > Flaky test: PagedTableSuite.pageNavigation >

[jira] [Created] (SPARK-25811) Support PyArrow's feature to raise an error for unsafe cast

Liang-Chi Hsieh created SPARK-25811: --- Summary: Support PyArrow's feature to raise an error for unsafe cast Key: SPARK-25811 URL: https://issues.apache.org/jira/browse/SPARK-25811 Project: Spark

[jira] [Updated] (SPARK-25793) Loading model bug in BisectingKMeans

[ https://issues.apache.org/jira/browse/SPARK-25793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25793: -- Target Version/s: 2.4.1, 3.0.0 (was: 2.4.1, 2.5.0) > Loading model bug in BisectingKMeans >

[jira] [Assigned] (SPARK-25812) Flaky test: PagedTableSuite.pageNavigation

[ https://issues.apache.org/jira/browse/SPARK-25812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25812: - Assignee: Gengliang Wang > Flaky test: PagedTableSuite.pageNavigation >

[jira] [Updated] (SPARK-25793) Loading model bug in BisectingKMeans

[ https://issues.apache.org/jira/browse/SPARK-25793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-25793: -- Target Version/s: 2.4.1, 2.5.0 > Loading model bug in BisectingKMeans >

[jira] [Resolved] (SPARK-25812) Flaky test: PagedTableSuite.pageNavigation

[ https://issues.apache.org/jira/browse/SPARK-25812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25812. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22808

[jira] [Created] (SPARK-25813) Unit Test "pageNavigation" for test suite PagedTableSuite.scala is failing for Apache Spark master branch

Parth Gandhi created SPARK-25813: Summary: Unit Test "pageNavigation" for test suite PagedTableSuite.scala is failing for Apache Spark master branch Key: SPARK-25813 URL:

[jira] [Assigned] (SPARK-25656) Add an example section about how to use Parquet/ORC library options

[ https://issues.apache.org/jira/browse/SPARK-25656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25656: - Assignee: Dongjoon Hyun > Add an example section about how to use Parquet/ORC library

[jira] [Resolved] (SPARK-25656) Add an example section about how to use Parquet/ORC library options

[ https://issues.apache.org/jira/browse/SPARK-25656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25656. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22801

[jira] [Commented] (SPARK-25813) Unit Test "pageNavigation" for test suite PagedTableSuite.scala is failing for Apache Spark master branch

[ https://issues.apache.org/jira/browse/SPARK-25813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661172#comment-16661172 ] Parth Gandhi commented on SPARK-25813: -- Duplicate JIRA, refer

[jira] [Resolved] (SPARK-25813) Unit Test "pageNavigation" for test suite PagedTableSuite.scala is failing for Apache Spark master branch

[ https://issues.apache.org/jira/browse/SPARK-25813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parth Gandhi resolved SPARK-25813. -- Resolution: Duplicate > Unit Test "pageNavigation" for test suite PagedTableSuite.scala is

[jira] [Created] (SPARK-25814) spark driver runs out of memory on org.apache.spark.util.kvstore.InMemoryStore

Ruslan Dautkhanov created SPARK-25814: - Summary: spark driver runs out of memory on org.apache.spark.util.kvstore.InMemoryStore Key: SPARK-25814 URL: https://issues.apache.org/jira/browse/SPARK-25814

[jira] [Updated] (SPARK-25814) spark driver runs out of memory on org.apache.spark.util.kvstore.InMemoryStore

[ https://issues.apache.org/jira/browse/SPARK-25814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-25814: -- Description:  We're looking into issue when even huge spark driver memory gets

[jira] [Updated] (SPARK-25814) spark driver runs out of memory on org.apache.spark.util.kvstore.InMemoryStore

[ https://issues.apache.org/jira/browse/SPARK-25814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-25814: -- Attachment: image-2018-10-23-14-06-53-722.png > spark driver runs out of memory on

[jira] [Updated] (SPARK-25814) spark driver runs out of memory on org.apache.spark.util.kvstore.InMemoryStore

[ https://issues.apache.org/jira/browse/SPARK-25814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-25814: -- Description:  We're looking into issue when even huge spark driver memory gets

[jira] [Updated] (SPARK-25814) spark driver runs out of memory on org.apache.spark.util.kvstore.InMemoryStore

[ https://issues.apache.org/jira/browse/SPARK-25814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-25814: -- Description:  We're looking into issue when even huge spark driver memory gets

[jira] [Commented] (SPARK-25814) spark driver runs out of memory on org.apache.spark.util.kvstore.InMemoryStore

[ https://issues.apache.org/jira/browse/SPARK-25814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661269#comment-16661269 ] Marcelo Vanzin commented on SPARK-25814: That's UI data. You can control how much UI data is

[jira] [Updated] (SPARK-25814) spark driver runs out of memory on org.apache.spark.util.kvstore.InMemoryStore

[ https://issues.apache.org/jira/browse/SPARK-25814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-25814: -- Priority: Major (was: Critical) > spark driver runs out of memory on

[jira] [Commented] (SPARK-25814) spark driver runs out of memory on org.apache.spark.util.kvstore.InMemoryStore

[ https://issues.apache.org/jira/browse/SPARK-25814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661282#comment-16661282 ] Ruslan Dautkhanov commented on SPARK-25814: --- thank you [~vanzin] ! I will try to tune those

[jira] [Updated] (SPARK-23257) Kerberos Support in Kubernetes resource manager (Cluster Mode)

[ https://issues.apache.org/jira/browse/SPARK-23257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilan Filonenko updated SPARK-23257: --- Summary: Kerberos Support in Kubernetes resource manager (Cluster Mode) (was: Implement

[jira] [Commented] (SPARK-22809) pyspark is sensitive to imports with dots

[ https://issues.apache.org/jira/browse/SPARK-22809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661418#comment-16661418 ] Bryan Cutler commented on SPARK-22809: -- I confirmed that I could reproduce in IPython with Spark

[jira] [Resolved] (SPARK-22809) pyspark is sensitive to imports with dots

[ https://issues.apache.org/jira/browse/SPARK-22809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-22809. -- Resolution: Fixed Fix Version/s: 2.4.0 > pyspark is sensitive to imports with dots >

[jira] [Commented] (SPARK-25801) pandas_udf grouped_map fails with input dataframe with more than 255 columns

[ https://issues.apache.org/jira/browse/SPARK-25801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661290#comment-16661290 ] Bryan Cutler commented on SPARK-25801: -- [~Toekan] you might try turning your features into an array

[jira] [Resolved] (SPARK-25801) pandas_udf grouped_map fails with input dataframe with more than 255 columns

[ https://issues.apache.org/jira/browse/SPARK-25801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-25801. -- Resolution: Fixed Fix Version/s: 2.4.0 > pandas_udf grouped_map fails with input

[jira] [Created] (SPARK-25815) Kerberos Support in Kubernetes resource manager (Client Mode)

Ilan Filonenko created SPARK-25815: -- Summary: Kerberos Support in Kubernetes resource manager (Client Mode) Key: SPARK-25815 URL: https://issues.apache.org/jira/browse/SPARK-25815 Project: Spark

[jira] [Commented] (SPARK-25807) Mitigate 1-based substr() confusion

[ https://issues.apache.org/jira/browse/SPARK-25807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661324#comment-16661324 ] kevin yu commented on SPARK-25807: -- I am looking into option 1, option 3 causes to change behavior,

[jira] [Commented] (SPARK-22809) pyspark is sensitive to imports with dots

[ https://issues.apache.org/jira/browse/SPARK-22809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661444#comment-16661444 ] Dongjoon Hyun commented on SPARK-22809: --- Hi, [~bryanc]. It seems that the test occurs in

[jira] [Updated] (SPARK-25816) Functions does not resolve Columns correctly

[ https://issues.apache.org/jira/browse/SPARK-25816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Zhang updated SPARK-25816: Attachment: source.snappy.parquet > Functions does not resolve Columns correctly >

[jira] [Created] (SPARK-25816) Functions does not resolve Columns correctly

Brian Zhang created SPARK-25816: --- Summary: Functions does not resolve Columns correctly Key: SPARK-25816 URL: https://issues.apache.org/jira/browse/SPARK-25816 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-22809) pyspark is sensitive to imports with dots

[ https://issues.apache.org/jira/browse/SPARK-22809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-22809: - Fix Version/s: 2.3.2 > pyspark is sensitive to imports with dots >

[jira] [Updated] (SPARK-25797) Views created via 2.1 cannot be read via 2.2+

[ https://issues.apache.org/jira/browse/SPARK-25797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenxiao Mao updated SPARK-25797: - Description: We ran into this issue when we update our Spark from 2.1 to 2.3. Below's a simple

[jira] [Assigned] (SPARK-25772) Java encoders - switch fields on collectAsList

[ https://issues.apache.org/jira/browse/SPARK-25772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-25772: --- Assignee: Vladimir Kuriatkov > Java encoders - switch fields on collectAsList >

[jira] [Updated] (SPARK-25797) Views created via 2.1 cannot be read via 2.2+

[ https://issues.apache.org/jira/browse/SPARK-25797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenxiao Mao updated SPARK-25797: - Description: We ran into this issue when we update our Spark from 2.1 to 2.3. Below's a simple

[jira] [Commented] (SPARK-25411) Implement range partition in Spark

[ https://issues.apache.org/jira/browse/SPARK-25411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661610#comment-16661610 ] Wang, Gang commented on SPARK-25411: [~cloud_fan] How do you think of this feature? In our inner

[jira] [Resolved] (SPARK-25772) Java encoders - switch fields on collectAsList

[ https://issues.apache.org/jira/browse/SPARK-25772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25772. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22745

[jira] [Commented] (SPARK-24516) PySpark Bindings for K8S - make Python 3 the default

[ https://issues.apache.org/jira/browse/SPARK-24516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661466#comment-16661466 ] Apache Spark commented on SPARK-24516: -- User 'ifilonenko' has created a pull request for this

[jira] [Commented] (SPARK-24516) PySpark Bindings for K8S - make Python 3 the default

[ https://issues.apache.org/jira/browse/SPARK-24516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661467#comment-16661467 ] Apache Spark commented on SPARK-24516: -- User 'ifilonenko' has created a pull request for this

[jira] [Assigned] (SPARK-24516) PySpark Bindings for K8S - make Python 3 the default

[ https://issues.apache.org/jira/browse/SPARK-24516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24516: Assignee: (was: Apache Spark) > PySpark Bindings for K8S - make Python 3 the default

[jira] [Assigned] (SPARK-24516) PySpark Bindings for K8S - make Python 3 the default

[ https://issues.apache.org/jira/browse/SPARK-24516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24516: Assignee: Apache Spark > PySpark Bindings for K8S - make Python 3 the default >

[jira] [Commented] (SPARK-22809) pyspark is sensitive to imports with dots

[ https://issues.apache.org/jira/browse/SPARK-22809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661502#comment-16661502 ] Bryan Cutler commented on SPARK-22809: -- Sure, I probably shouldn't have tested out of the branches.

[jira] [Commented] (SPARK-25810) Spark structured streaming logs auto.offset.reset=earliest even though startingOffsets is set to latest

[ https://issues.apache.org/jira/browse/SPARK-25810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661703#comment-16661703 ] sandeep katta commented on SPARK-25810: --- {color:#FF}[~abanthiy] {color}thanks for reporting

[jira] [Commented] (SPARK-19851) Add support for EVERY and ANY (SOME) aggregates

[ https://issues.apache.org/jira/browse/SPARK-19851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660955#comment-16660955 ] Apache Spark commented on SPARK-19851: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-25817) Dataset encoder should support combination of map and product type

[ https://issues.apache.org/jira/browse/SPARK-25817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25817: Assignee: Apache Spark (was: Wenchen Fan) > Dataset encoder should support combination

[jira] [Commented] (SPARK-25817) Dataset encoder should support combination of map and product type

[ https://issues.apache.org/jira/browse/SPARK-25817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661714#comment-16661714 ] Apache Spark commented on SPARK-25817: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25817) Dataset encoder should support combination of map and product type

[ https://issues.apache.org/jira/browse/SPARK-25817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25817: Assignee: Wenchen Fan (was: Apache Spark) > Dataset encoder should support combination

[jira] [Commented] (SPARK-25817) Dataset encoder should support combination of map and product type

[ https://issues.apache.org/jira/browse/SPARK-25817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661713#comment-16661713 ] Apache Spark commented on SPARK-25817: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-25817) Dataset encoder should support combination of map and product type

Wenchen Fan created SPARK-25817: --- Summary: Dataset encoder should support combination of map and product type Key: SPARK-25817 URL: https://issues.apache.org/jira/browse/SPARK-25817 Project: Spark

[jira] [Updated] (SPARK-25804) JDOPersistenceManager leak when query via JDBC

[ https://issues.apache.org/jira/browse/SPARK-25804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pin_zhang updated SPARK-25804: -- Description: 1. start-thriftserver.sh under SPARK2.3.1 2. Create Table and insert values