[jira] [Commented] (SPARK-24417) Build and Run Spark on JDK11

[ https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677040#comment-16677040 ] Dongjoon Hyun commented on SPARK-24417: --- +1 for moving to Scala 2.12 as default Scala version. >

[jira] [Commented] (SPARK-25952) from_json returns wrong result if corrupt record column is in the middle of schema

[ https://issues.apache.org/jira/browse/SPARK-25952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677073#comment-16677073 ] Apache Spark commented on SPARK-25952: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25952) from_json returns wrong result if corrupt record column is in the middle of schema

[ https://issues.apache.org/jira/browse/SPARK-25952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25952: Assignee: Apache Spark > from_json returns wrong result if corrupt record column is in

[jira] [Assigned] (SPARK-25952) from_json returns wrong result if corrupt record column is in the middle of schema

[ https://issues.apache.org/jira/browse/SPARK-25952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25952: Assignee: (was: Apache Spark) > from_json returns wrong result if corrupt record

[jira] [Commented] (SPARK-25954) Upgrade to Kafka 2.1.0

[ https://issues.apache.org/jira/browse/SPARK-25954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677152#comment-16677152 ] Ted Yu commented on SPARK-25954: Looking at Kafka thread, message from Satish indicated there may be

[jira] [Created] (SPARK-25953) install jdk11 on jenkins workers

shane knapp created SPARK-25953: --- Summary: install jdk11 on jenkins workers Key: SPARK-25953 URL: https://issues.apache.org/jira/browse/SPARK-25953 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-25954) Upgrade to Kafka 2.1.0

[ https://issues.apache.org/jira/browse/SPARK-25954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677107#comment-16677107 ] Dongjoon Hyun commented on SPARK-25954: --- Ping, [~te...@apache.org]. Are you interested in this

[jira] [Commented] (SPARK-25954) Upgrade to Kafka 2.1.0

[ https://issues.apache.org/jira/browse/SPARK-25954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677163#comment-16677163 ] Dongjoon Hyun commented on SPARK-25954: --- Thanks. Of course, it's for Spark 3.0 next year. >

[jira] [Created] (SPARK-25952) from_json returns wrong result if corrupt record column is in the middle of schema

Maxim Gekk created SPARK-25952: -- Summary: from_json returns wrong result if corrupt record column is in the middle of schema Key: SPARK-25952 URL: https://issues.apache.org/jira/browse/SPARK-25952

[jira] [Assigned] (SPARK-25876) Simplify configuration types in k8s backend

[ https://issues.apache.org/jira/browse/SPARK-25876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25876: Assignee: Apache Spark > Simplify configuration types in k8s backend >

[jira] [Commented] (SPARK-25876) Simplify configuration types in k8s backend

[ https://issues.apache.org/jira/browse/SPARK-25876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677135#comment-16677135 ] Apache Spark commented on SPARK-25876: -- User 'vanzin' has created a pull request for this issue:

[jira] [Created] (SPARK-25954) Upgrade to Kafka 2.1.0

Dongjoon Hyun created SPARK-25954: - Summary: Upgrade to Kafka 2.1.0 Key: SPARK-25954 URL: https://issues.apache.org/jira/browse/SPARK-25954 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-25953) install jdk11 on jenkins workers

[ https://issues.apache.org/jira/browse/SPARK-25953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp updated SPARK-25953: Description: once we pin down exact what we want installed on the jenkins workers, i will add it

[jira] [Updated] (SPARK-25222) Spark on Kubernetes Pod Watcher dumps raw container status

[ https://issues.apache.org/jira/browse/SPARK-25222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-25222: --- Fix Version/s: 3.0.0 > Spark on Kubernetes Pod Watcher dumps raw container status >

[jira] [Assigned] (SPARK-25222) Spark on Kubernetes Pod Watcher dumps raw container status

[ https://issues.apache.org/jira/browse/SPARK-25222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25222: -- Assignee: Rob Vesse > Spark on Kubernetes Pod Watcher dumps raw container status >

[jira] [Commented] (SPARK-25876) Simplify configuration types in k8s backend

[ https://issues.apache.org/jira/browse/SPARK-25876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677138#comment-16677138 ] Apache Spark commented on SPARK-25876: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25876) Simplify configuration types in k8s backend

[ https://issues.apache.org/jira/browse/SPARK-25876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25876: Assignee: (was: Apache Spark) > Simplify configuration types in k8s backend >

[jira] [Resolved] (SPARK-25871) Streaming WAL should not use hdfs erasure coding, regardless of FS defaults

[ https://issues.apache.org/jira/browse/SPARK-25871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25871. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22882

[jira] [Assigned] (SPARK-25871) Streaming WAL should not use hdfs erasure coding, regardless of FS defaults

[ https://issues.apache.org/jira/browse/SPARK-25871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25871: -- Assignee: Imran Rashid > Streaming WAL should not use hdfs erasure coding,

[jira] [Updated] (SPARK-24771) Upgrade AVRO version from 1.7.7 to 1.8.2

[ https://issues.apache.org/jira/browse/SPARK-24771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24771: -- Summary: Upgrade AVRO version from 1.7.7 to 1.8.2 (was: Upgrade AVRO version from 1.7.7 to

[jira] [Resolved] (SPARK-17166) CTAS lost table properties after conversion to data source tables.

[ https://issues.apache.org/jira/browse/SPARK-17166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-17166. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.4.0 It is

[jira] [Commented] (SPARK-17967) Support for list or other types as an option for datasources

[ https://issues.apache.org/jira/browse/SPARK-17967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677478#comment-16677478 ] Hyukjin Kwon commented on SPARK-17967: -- For CSV itself, yea, there are workaround and I agree - for

[jira] [Created] (SPARK-25958) error: [Errno 97] Address family not supported by protocol in dataframe.take()

Ruslan Dautkhanov created SPARK-25958: - Summary: error: [Errno 97] Address family not supported by protocol in dataframe.take() Key: SPARK-25958 URL: https://issues.apache.org/jira/browse/SPARK-25958

[jira] [Commented] (SPARK-17967) Support for list or other types as an option for datasources

[ https://issues.apache.org/jira/browse/SPARK-17967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677486#comment-16677486 ] Hyukjin Kwon commented on SPARK-17967: -- It's a rough idea but I was also thinking allowing binary

[jira] [Created] (SPARK-25955) Porting JSON test for CSV functions

Maxim Gekk created SPARK-25955: -- Summary: Porting JSON test for CSV functions Key: SPARK-25955 URL: https://issues.apache.org/jira/browse/SPARK-25955 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-25922) [K8] Spark Driver/Executor "spark-app-selector" label mismatch

[ https://issues.apache.org/jira/browse/SPARK-25922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677276#comment-16677276 ] Yinan Li commented on SPARK-25922: -- The application ID used to set the {{spark-app-selector}} label for

[jira] [Commented] (SPARK-24421) sun.misc.Unsafe in JDK9+

[ https://issues.apache.org/jira/browse/SPARK-24421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677280#comment-16677280 ] Sean Owen commented on SPARK-24421: --- BTW thanks for the tip [~akorzhuev] ; I checked and unfortunately

[jira] [Created] (SPARK-25956) Make Scala 2.12 as default Scala version in Spark 3.0

DB Tsai created SPARK-25956: --- Summary: Make Scala 2.12 as default Scala version in Spark 3.0 Key: SPARK-25956 URL: https://issues.apache.org/jira/browse/SPARK-25956 Project: Spark Issue Type:

[jira] [Updated] (SPARK-24422) Add JDK11 in our Jenkins' build servers

[ https://issues.apache.org/jira/browse/SPARK-24422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-24422: Summary: Add JDK11 in our Jenkins' build servers (was: Add JDK9+ in our Jenkins' build servers) > Add

[jira] [Assigned] (SPARK-25947) Reduce memory usage in ShuffleExchangeExec by selecting only the sort columns

[ https://issues.apache.org/jira/browse/SPARK-25947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25947: Assignee: Apache Spark > Reduce memory usage in ShuffleExchangeExec by selecting only

[jira] [Commented] (SPARK-25947) Reduce memory usage in ShuffleExchangeExec by selecting only the sort columns

[ https://issues.apache.org/jira/browse/SPARK-25947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677513#comment-16677513 ] Apache Spark commented on SPARK-25947: -- User 'mu5358271' has created a pull request for this issue:

[jira] [Commented] (SPARK-25947) Reduce memory usage in ShuffleExchangeExec by selecting only the sort columns

[ https://issues.apache.org/jira/browse/SPARK-25947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677514#comment-16677514 ] Apache Spark commented on SPARK-25947: -- User 'mu5358271' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25947) Reduce memory usage in ShuffleExchangeExec by selecting only the sort columns

[ https://issues.apache.org/jira/browse/SPARK-25947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25947: Assignee: (was: Apache Spark) > Reduce memory usage in ShuffleExchangeExec by

[jira] [Assigned] (SPARK-25950) from_csv should respect to spark.sql.columnNameOfCorruptRecord

[ https://issues.apache.org/jira/browse/SPARK-25950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25950: Assignee: Maxim Gekk > from_csv should respect to spark.sql.columnNameOfCorruptRecord >

[jira] [Created] (SPARK-25957) Skip building spark-r docker image if spark distribution does not have R support

Nagaram Prasad Addepally created SPARK-25957: Summary: Skip building spark-r docker image if spark distribution does not have R support Key: SPARK-25957 URL:

[jira] [Updated] (SPARK-25957) Skip building spark-r docker image if spark distribution does not have R support

[ https://issues.apache.org/jira/browse/SPARK-25957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nagaram Prasad Addepally updated SPARK-25957: - Description:

[jira] [Resolved] (SPARK-25950) from_csv should respect to spark.sql.columnNameOfCorruptRecord

[ https://issues.apache.org/jira/browse/SPARK-25950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25950. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22956

[jira] [Created] (SPARK-25959) Difference in featureImportances results on computed vs saved models

Suraj Nayak created SPARK-25959: --- Summary: Difference in featureImportances results on computed vs saved models Key: SPARK-25959 URL: https://issues.apache.org/jira/browse/SPARK-25959 Project: Spark

[jira] [Commented] (SPARK-25959) Difference in featureImportances results on computed vs saved models

[ https://issues.apache.org/jira/browse/SPARK-25959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677752#comment-16677752 ] shahid commented on SPARK-25959: Thanks. I will analyze the issue. > Difference in featureImportances

[jira] [Updated] (SPARK-18466) Missing withFilter method causes errors when using for comprehensions

[ https://issues.apache.org/jira/browse/SPARK-18466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-18466: -- Summary: Missing withFilter method causes errors when using for comprehensions (was: Missing

[jira] [Updated] (SPARK-18466) Missing withFilter method causes errors when using for comprehensions in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-18466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-18466: -- Summary: Missing withFilter method causes errors when using for comprehensions in Scala 2.12

[jira] [Updated] (SPARK-18466) Missing withFilter method causes errors when using for comprehensions in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-18466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-18466: -- Affects Version/s: (was: 2.3.0) (was: 2.0.2)

[jira] [Created] (SPARK-25960) Support subpath mounting with Kubernetes

Timothy Chen created SPARK-25960: Summary: Support subpath mounting with Kubernetes Key: SPARK-25960 URL: https://issues.apache.org/jira/browse/SPARK-25960 Project: Spark Issue Type: New

[jira] [Closed] (SPARK-18466) Missing withFilter method causes warnings when using for comprehensions

[ https://issues.apache.org/jira/browse/SPARK-18466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-18466. - > Missing withFilter method causes warnings when using for comprehensions >

[jira] [Resolved] (SPARK-18466) Missing withFilter method causes warnings when using for comprehensions

[ https://issues.apache.org/jira/browse/SPARK-18466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-18466. --- Resolution: Won't Fix Thank you for reporting and contribution, [~reggert1980]. We know

[jira] [Resolved] (SPARK-25098) ‘Cast’ will return NULL when input string starts/ends with special character(s)

[ https://issues.apache.org/jira/browse/SPARK-25098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25098. --- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 This is

[jira] [Updated] (SPARK-25098) Trim the string when cast stringToTimestamp and stringToDate

[ https://issues.apache.org/jira/browse/SPARK-25098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25098: -- Summary: Trim the string when cast stringToTimestamp and stringToDate (was: ‘Cast’ will

[jira] [Updated] (SPARK-18466) Missing withFilter method causes warnings when using for comprehensions

[ https://issues.apache.org/jira/browse/SPARK-18466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-18466: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-24417 > Missing withFilter

[jira] [Updated] (SPARK-18466) Missing withFilter method causes warnings when using for comprehensions

[ https://issues.apache.org/jira/browse/SPARK-18466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-18466: -- Affects Version/s: 2.4.0 2.3.0 > Missing withFilter method causes

[jira] [Commented] (SPARK-17967) Support for list or other types as an option for datasources

[ https://issues.apache.org/jira/browse/SPARK-17967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677418#comment-16677418 ] Reynold Xin commented on SPARK-17967: - BTW how important is this? Seems like for CSV people can just

[jira] [Assigned] (SPARK-25955) Porting JSON test for CSV functions

[ https://issues.apache.org/jira/browse/SPARK-25955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25955: Assignee: Apache Spark > Porting JSON test for CSV functions >

[jira] [Commented] (SPARK-25955) Porting JSON test for CSV functions

[ https://issues.apache.org/jira/browse/SPARK-25955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677272#comment-16677272 ] Apache Spark commented on SPARK-25955: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25955) Porting JSON test for CSV functions

[ https://issues.apache.org/jira/browse/SPARK-25955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25955: Assignee: (was: Apache Spark) > Porting JSON test for CSV functions >

[jira] [Resolved] (SPARK-25676) Refactor BenchmarkWideTable to use main method

[ https://issues.apache.org/jira/browse/SPARK-25676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25676. --- Resolution: Fixed Assignee: yucai Fix Version/s: 3.0.0 This is resolved via

[jira] [Resolved] (SPARK-20389) Upgrade kryo to fix NegativeArraySizeException

[ https://issues.apache.org/jira/browse/SPARK-20389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-20389. - Resolution: Duplicate Fixed by https://github.com/apache/spark/pull/22179 > Upgrade kryo to

[jira] [Commented] (SPARK-25937) Support user-defined schema in Kafka Source & Sink

[ https://issues.apache.org/jira/browse/SPARK-25937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676374#comment-16676374 ] Jackey Lee commented on SPARK-25937: Not exactly the same thing. The current implementation is to

[jira] [Created] (SPARK-25949) Add test for optimize rule PullOutPythonUDFInJoinCondition

Yuanjian Li created SPARK-25949: --- Summary: Add test for optimize rule PullOutPythonUDFInJoinCondition Key: SPARK-25949 URL: https://issues.apache.org/jira/browse/SPARK-25949 Project: Spark

[jira] [Updated] (SPARK-25949) Add test for optimizer rule PullOutPythonUDFInJoinCondition

[ https://issues.apache.org/jira/browse/SPARK-25949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-25949: Summary: Add test for optimizer rule PullOutPythonUDFInJoinCondition (was: Add test for optimize

[jira] [Commented] (SPARK-25949) Add test for optimizer rule PullOutPythonUDFInJoinCondition

[ https://issues.apache.org/jira/browse/SPARK-25949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676702#comment-16676702 ] Apache Spark commented on SPARK-25949: -- User 'xuanyuanking' has created a pull request for this

[jira] [Assigned] (SPARK-25949) Add test for optimizer rule PullOutPythonUDFInJoinCondition

[ https://issues.apache.org/jira/browse/SPARK-25949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25949: Assignee: (was: Apache Spark) > Add test for optimizer rule

[jira] [Assigned] (SPARK-25949) Add test for optimizer rule PullOutPythonUDFInJoinCondition

[ https://issues.apache.org/jira/browse/SPARK-25949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25949: Assignee: Apache Spark > Add test for optimizer rule PullOutPythonUDFInJoinCondition >

[jira] [Commented] (SPARK-25949) Add test for optimizer rule PullOutPythonUDFInJoinCondition

[ https://issues.apache.org/jira/browse/SPARK-25949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676703#comment-16676703 ] Apache Spark commented on SPARK-25949: -- User 'xuanyuanking' has created a pull request for this

[jira] [Assigned] (SPARK-25950) from_csv should respect to spark.sql.columnNameOfCorruptRecord

[ https://issues.apache.org/jira/browse/SPARK-25950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25950: Assignee: (was: Apache Spark) > from_csv should respect to

[jira] [Commented] (SPARK-25950) from_csv should respect to spark.sql.columnNameOfCorruptRecord

[ https://issues.apache.org/jira/browse/SPARK-25950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676751#comment-16676751 ] Apache Spark commented on SPARK-25950: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Resolved] (SPARK-15815) Hang while enable blacklistExecutor and DynamicExecutorAllocator

[ https://issues.apache.org/jira/browse/SPARK-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-15815. --- Resolution: Duplicate > Hang while enable blacklistExecutor and DynamicExecutorAllocator >

[jira] [Created] (SPARK-25950) from_csv should respect to spark.sql.columnNameOfCorruptRecord

Maxim Gekk created SPARK-25950: -- Summary: from_csv should respect to spark.sql.columnNameOfCorruptRecord Key: SPARK-25950 URL: https://issues.apache.org/jira/browse/SPARK-25950 Project: Spark

[jira] [Commented] (SPARK-25950) from_csv should respect to spark.sql.columnNameOfCorruptRecord

[ https://issues.apache.org/jira/browse/SPARK-25950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676752#comment-16676752 ] Apache Spark commented on SPARK-25950: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25950) from_csv should respect to spark.sql.columnNameOfCorruptRecord

[ https://issues.apache.org/jira/browse/SPARK-25950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25950: Assignee: Apache Spark > from_csv should respect to spark.sql.columnNameOfCorruptRecord

[jira] [Resolved] (SPARK-22148) TaskSetManager.abortIfCompletelyBlacklisted should not abort when all current executors are blacklisted but dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-22148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-22148. --- Resolution: Fixed Fix Version/s: 3.0.0 2.4.1 >

[jira] [Assigned] (SPARK-22148) TaskSetManager.abortIfCompletelyBlacklisted should not abort when all current executors are blacklisted but dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-22148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-22148: - Assignee: Dhruve Ashar > TaskSetManager.abortIfCompletelyBlacklisted should not abort

[jira] [Updated] (SPARK-25951) Redundant shuffle if column is renamed

[ https://issues.apache.org/jira/browse/SPARK-25951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ohad Raviv updated SPARK-25951: --- Description: we've noticed that sometimes a column rename causes extra shuffle: {code} val N = 1 <<

[jira] [Created] (SPARK-25951) Redundant shuffle if column is renamed

Ohad Raviv created SPARK-25951: -- Summary: Redundant shuffle if column is renamed Key: SPARK-25951 URL: https://issues.apache.org/jira/browse/SPARK-25951 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-25866) Update KMeans formatVersion

[ https://issues.apache.org/jira/browse/SPARK-25866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-25866: --- Assignee: Marco Gaido > Update KMeans formatVersion > --- > >

[jira] [Resolved] (SPARK-25866) Update KMeans formatVersion

[ https://issues.apache.org/jira/browse/SPARK-25866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25866. - Resolution: Fixed Fix Version/s: 3.0.0 2.4.1 Issue resolved by pull

[jira] [Updated] (SPARK-25951) Redundant shuffle if column is renamed

[ https://issues.apache.org/jira/browse/SPARK-25951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ohad Raviv updated SPARK-25951: --- Description: we've noticed that sometimes a column rename causes extra shuffle: {code:java} val N =

[jira] [Assigned] (SPARK-25951) Redundant shuffle if column is renamed

[ https://issues.apache.org/jira/browse/SPARK-25951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25951: Assignee: Apache Spark > Redundant shuffle if column is renamed >

[jira] [Commented] (SPARK-25951) Redundant shuffle if column is renamed

[ https://issues.apache.org/jira/browse/SPARK-25951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676941#comment-16676941 ] Apache Spark commented on SPARK-25951: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Commented] (SPARK-25951) Redundant shuffle if column is renamed

[ https://issues.apache.org/jira/browse/SPARK-25951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676942#comment-16676942 ] Apache Spark commented on SPARK-25951: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25951) Redundant shuffle if column is renamed

[ https://issues.apache.org/jira/browse/SPARK-25951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25951: Assignee: (was: Apache Spark) > Redundant shuffle if column is renamed >