[jira] [Comment Edited] (SPARK-26770) Misleading/unhelpful error message when wrapping a null in an Option

[ https://issues.apache.org/jira/browse/SPARK-26770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780193#comment-16780193 ] nivedita singh edited comment on SPARK-26770 at 2/28/19 7:28 AM: - I can

[jira] [Comment Edited] (SPARK-26770) Misleading/unhelpful error message when wrapping a null in an Option

[ https://issues.apache.org/jira/browse/SPARK-26770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780193#comment-16780193 ] nivedita singh edited comment on SPARK-26770 at 2/28/19 7:26 AM: - I can

[jira] [Commented] (SPARK-26770) Misleading/unhelpful error message when wrapping a null in an Option

[ https://issues.apache.org/jira/browse/SPARK-26770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780193#comment-16780193 ] nivedita singh commented on SPARK-26770: I can see this NPE while creating productExtract.

[jira] [Commented] (SPARK-27006) SPIP: .NET bindings for Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-27006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780184#comment-16780184 ] Dongjoon Hyun commented on SPARK-27006: --- +1 for [~srowen]'s comment. [~imback82], please avoid to

[jira] [Updated] (SPARK-27006) SPIP: .NET bindings for Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-27006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27006: -- Target Version/s: (was: 3.0.0) > SPIP: .NET bindings for Apache Spark >

[jira] [Updated] (SPARK-27006) SPIP: .NET bindings for Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-27006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27006: -- Fix Version/s: (was: 3.0.0) > SPIP: .NET bindings for Apache Spark >

[jira] [Updated] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26985: - Priority: Major (was: Critical) > Test "access only some column of the all of columns " fails

[jira] [Commented] (SPARK-26998) spark.ssl.keyStorePassword in plaintext on 'ps -ef' output of executor processes in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780118#comment-16780118 ] Hyukjin Kwon commented on SPARK-26998: -- can you reopen the PR and proceed? >

[jira] [Commented] (SPARK-26994) Enhance StructField to accept number format or date format

[ https://issues.apache.org/jira/browse/SPARK-26994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780117#comment-16780117 ] Hyukjin Kwon commented on SPARK-26994: -- Can you show expected input and output in the JIRA? >

[jira] [Commented] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780116#comment-16780116 ] Hyukjin Kwon commented on SPARK-26985: -- [~Anuja], I am sure there're multiple JIRAs related to big

[jira] [Commented] (SPARK-26839) on JDK11, IsolatedClientLoader must be able to load java.sql classes

[ https://issues.apache.org/jira/browse/SPARK-26839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780085#comment-16780085 ] Sean Owen commented on SPARK-26839: --- Sure. It may be that we need to access the platform classloader

[jira] [Resolved] (SPARK-26940) Observed greater deviation on big endian platform for SingletonReplSuite test case

[ https://issues.apache.org/jira/browse/SPARK-26940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26940. --- Resolution: Not A Problem Target Version/s: (was: 2.3.2) > Observed greater deviation

[jira] [Updated] (SPARK-26940) Observed greater deviation on big endian platform for SingletonReplSuite test case

[ https://issues.apache.org/jira/browse/SPARK-26940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26940: -- Priority: Minor (was: Critical) I haven't observed this test fail and don't see it would have

[jira] [Updated] (SPARK-24615) SPIP: Accelerator-aware task scheduling for Spark

[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-24615: -- Summary: SPIP: Accelerator-aware task scheduling for Spark (was: Accelerator-aware task

[jira] [Updated] (SPARK-26192) MesosClusterScheduler reads options from dispatcher conf instead of submission conf

[ https://issues.apache.org/jira/browse/SPARK-26192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Loncaric updated SPARK-26192: Description: There are at least two options accessed in MesosClusterScheduler that should

[jira] [Comment Edited] (SPARK-26997) k8s integration tests failing after client upgraded to 4.1.2

[ https://issues.apache.org/jira/browse/SPARK-26997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779881#comment-16779881 ] shane knapp edited comment on SPARK-26997 at 2/28/19 12:10 AM: --- great

[jira] [Resolved] (SPARK-23682) Memory issue with Spark structured streaming

[ https://issues.apache.org/jira/browse/SPARK-23682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-23682. -- Resolution: Duplicate Fix Version/s: 2.4.0 > Memory issue with Spark structured

[jira] [Commented] (SPARK-23682) Memory issue with Spark structured streaming

[ https://issues.apache.org/jira/browse/SPARK-23682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779914#comment-16779914 ] Jungtaek Lim commented on SPARK-23682: -- [~zhongchiyu] Thanks for reporting! Let me close this as

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.1

[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779893#comment-16779893 ] shane knapp commented on SPARK-26742: - we can fix this next week.  see:  

[jira] [Commented] (SPARK-26997) k8s integration tests failing after client upgraded to 4.1.2

[ https://issues.apache.org/jira/browse/SPARK-26997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779881#comment-16779881 ] shane knapp commented on SPARK-26997: - great news, everyone!  :) i was able to get everything

[jira] [Assigned] (SPARK-27009) Add standard deviation to Benchmark tests

[ https://issues.apache.org/jira/browse/SPARK-27009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27009: Assignee: (was: Apache Spark) > Add standard deviation to Benchmark tests >

[jira] [Assigned] (SPARK-27009) Add standard deviation to Benchmark tests

[ https://issues.apache.org/jira/browse/SPARK-27009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27009: Assignee: Apache Spark > Add standard deviation to Benchmark tests >

[jira] [Created] (SPARK-27009) Add standard deviation to Benchmark tests

Yifei Huang created SPARK-27009: --- Summary: Add standard deviation to Benchmark tests Key: SPARK-27009 URL: https://issues.apache.org/jira/browse/SPARK-27009 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-27008) Support java.time.LocalDate as an external type of DateType

[ https://issues.apache.org/jira/browse/SPARK-27008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27008: Assignee: Apache Spark > Support java.time.LocalDate as an external type of DateType >

[jira] [Assigned] (SPARK-27008) Support java.time.LocalDate as an external type of DateType

[ https://issues.apache.org/jira/browse/SPARK-27008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27008: Assignee: (was: Apache Spark) > Support java.time.LocalDate as an external type of

[jira] [Created] (SPARK-27008) Support java.time.LocalDate as an external type of DateType

Maxim Gekk created SPARK-27008: -- Summary: Support java.time.LocalDate as an external type of DateType Key: SPARK-27008 URL: https://issues.apache.org/jira/browse/SPARK-27008 Project: Spark

[jira] [Commented] (SPARK-21029) All StreamingQuery should be stopped when the SparkSession is stopped

[ https://issues.apache.org/jira/browse/SPARK-21029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779765#comment-16779765 ] Arun Mahadevan commented on SPARK-21029: I encountered this issue and propose an alternative

[jira] [Assigned] (SPARK-27007) add rawPrediction to OneVsRest in PySpark

[ https://issues.apache.org/jira/browse/SPARK-27007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27007: Assignee: Apache Spark > add rawPrediction to OneVsRest in PySpark >

[jira] [Assigned] (SPARK-27007) add rawPrediction to OneVsRest in PySpark

[ https://issues.apache.org/jira/browse/SPARK-27007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27007: Assignee: (was: Apache Spark) > add rawPrediction to OneVsRest in PySpark >

[jira] [Created] (SPARK-27007) add rawPrediction to OneVsRest in PySpark

Huaxin Gao created SPARK-27007: -- Summary: add rawPrediction to OneVsRest in PySpark Key: SPARK-27007 URL: https://issues.apache.org/jira/browse/SPARK-27007 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-26997) k8s integration tests failing after client upgraded to 4.1.2

[ https://issues.apache.org/jira/browse/SPARK-26997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779599#comment-16779599 ] shane knapp edited comment on SPARK-26997 at 2/27/19 6:49 PM: -- i just

[jira] [Commented] (SPARK-26997) k8s integration tests failing after client upgraded to 4.1.2

[ https://issues.apache.org/jira/browse/SPARK-26997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779599#comment-16779599 ] shane knapp commented on SPARK-26997: - i just confirmed that k8s 1.10.0 is definitely incompatible

[jira] [Commented] (SPARK-27006) SPIP: .NET bindings for Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-27006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779595#comment-16779595 ] Sean Owen commented on SPARK-27006: --- It'd be much, much better if this can, at least, start outside

[jira] [Updated] (SPARK-26984) Incompatibility between Spark releases - Some(null)

[ https://issues.apache.org/jira/browse/SPARK-26984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26984: - Description: Please refer to

[jira] [Updated] (SPARK-26984) Incompatibility between Spark releases - Some(null)

[ https://issues.apache.org/jira/browse/SPARK-26984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26984: - Description: Please refer to

[jira] [Assigned] (SPARK-27002) Latest kafka delegation token not always picked up

[ https://issues.apache.org/jira/browse/SPARK-27002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27002: -- Assignee: Gabor Somogyi > Latest kafka delegation token not always picked up >

[jira] [Resolved] (SPARK-27002) Latest kafka delegation token not always picked up

[ https://issues.apache.org/jira/browse/SPARK-27002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27002. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23906

[jira] [Assigned] (SPARK-24063) Control maximum epoch backlog

[ https://issues.apache.org/jira/browse/SPARK-24063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24063: -- Assignee: Gabor Somogyi > Control maximum epoch backlog >

[jira] [Resolved] (SPARK-24063) Control maximum epoch backlog

[ https://issues.apache.org/jira/browse/SPARK-24063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24063. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23156

[jira] [Assigned] (SPARK-24736) --py-files not functional for non local URLs. It appears to pass non-local URL's into PYTHONPATH directly.

[ https://issues.apache.org/jira/browse/SPARK-24736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24736: -- Assignee: Marcelo Vanzin > --py-files not functional for non local URLs. It appears

[jira] [Resolved] (SPARK-24736) --py-files not functional for non local URLs. It appears to pass non-local URL's into PYTHONPATH directly.

[ https://issues.apache.org/jira/browse/SPARK-24736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24736. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23793

[jira] [Resolved] (SPARK-27000) Global function that has the same name can't be overwritten in Python RDD API

[ https://issues.apache.org/jira/browse/SPARK-27000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27000. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23904

[jira] [Created] (SPARK-27006) SPIP: .NET bindings for Apache Spark

Terry Kim created SPARK-27006: - Summary: SPIP: .NET bindings for Apache Spark Key: SPARK-27006 URL: https://issues.apache.org/jira/browse/SPARK-27006 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-27005) Design sketch: Accelerator-aware scheduling

[ https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779503#comment-16779503 ] Xingbo Jiang edited comment on SPARK-27005 at 2/27/19 4:50 PM: --- *API

[jira] [Comment Edited] (SPARK-27005) Design sketch: Accelerator-aware scheduling

[ https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779503#comment-16779503 ] Xingbo Jiang edited comment on SPARK-27005 at 2/27/19 4:49 PM: --- *API

[jira] [Updated] (SPARK-24615) Accelerator-aware task scheduling for Spark

[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-24615: - Epic Name: Support GPU Scheduling > Accelerator-aware task scheduling for Spark >

[jira] [Comment Edited] (SPARK-27005) Design sketch: Accelerator-aware scheduling

[ https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779503#comment-16779503 ] Xingbo Jiang edited comment on SPARK-27005 at 2/27/19 4:48 PM: --- *API

[jira] [Comment Edited] (SPARK-27005) Design sketch: Accelerator-aware scheduling

[ https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779503#comment-16779503 ] Xingbo Jiang edited comment on SPARK-27005 at 2/27/19 4:48 PM: --- *API

[jira] [Commented] (SPARK-27005) Design sketch: Accelerator-aware scheduling

[ https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779503#comment-16779503 ] Xingbo Jiang commented on SPARK-27005: -- *API Changes [draft pending design discussion]* class

[jira] [Created] (SPARK-27005) Design sketch: Accelerator-aware scheduling

Xingbo Jiang created SPARK-27005: Summary: Design sketch: Accelerator-aware scheduling Key: SPARK-27005 URL: https://issues.apache.org/jira/browse/SPARK-27005 Project: Spark Issue Type:

[jira] [Updated] (SPARK-24615) Accelerator-aware task scheduling for Spark

[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-24615: - Issue Type: Epic (was: Improvement) > Accelerator-aware task scheduling for Spark >

[jira] [Resolved] (SPARK-26890) Add Dropwizard metrics list and additional configuration details to the documentation

[ https://issues.apache.org/jira/browse/SPARK-26890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26890. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23798

[jira] [Commented] (SPARK-21492) Memory leak in SortMergeJoin

[ https://issues.apache.org/jira/browse/SPARK-21492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779460#comment-16779460 ] Guruprasad commented on SPARK-21492: i ran the sample code provided on spark 2.0.2 and it used

[jira] [Assigned] (SPARK-26890) Add Dropwizard metrics list and additional configuration details to the documentation

[ https://issues.apache.org/jira/browse/SPARK-26890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26890: - Assignee: Luca Canali > Add Dropwizard metrics list and additional configuration details to

[jira] [Commented] (SPARK-26783) Kafka parameter documentation doesn't match with the reality (upper/lowercase)

[ https://issues.apache.org/jira/browse/SPARK-26783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779408#comment-16779408 ] Gabor Somogyi commented on SPARK-26783: --- I've gone through the whole chain on v2.4.0 and it looks

[jira] [Resolved] (SPARK-26783) Kafka parameter documentation doesn't match with the reality (upper/lowercase)

[ https://issues.apache.org/jira/browse/SPARK-26783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi resolved SPARK-26783. --- Resolution: Not A Bug > Kafka parameter documentation doesn't match with the reality

[jira] [Comment Edited] (SPARK-26783) Kafka parameter documentation doesn't match with the reality (upper/lowercase)

[ https://issues.apache.org/jira/browse/SPARK-26783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779408#comment-16779408 ] Gabor Somogyi edited comment on SPARK-26783 at 2/27/19 2:56 PM: I've

[jira] [Assigned] (SPARK-26803) include sbin subdirectory in pyspark

[ https://issues.apache.org/jira/browse/SPARK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26803: - Assignee: Oliver Urs Lenz > include sbin subdirectory in pyspark >

[jira] [Resolved] (SPARK-26803) include sbin subdirectory in pyspark

[ https://issues.apache.org/jira/browse/SPARK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26803. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23715

[jira] [Assigned] (SPARK-27001) Refactor "serializerFor" method between ScalaReflection and JavaTypeInference

[ https://issues.apache.org/jira/browse/SPARK-27001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27001: Assignee: Apache Spark > Refactor "serializerFor" method between ScalaReflection and

[jira] [Assigned] (SPARK-27001) Refactor "serializerFor" method between ScalaReflection and JavaTypeInference

[ https://issues.apache.org/jira/browse/SPARK-27001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27001: Assignee: (was: Apache Spark) > Refactor "serializerFor" method between

[jira] [Commented] (SPARK-27003) [Spark]Message display at console is not correct for spark.executor.instances

[ https://issues.apache.org/jira/browse/SPARK-27003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779354#comment-16779354 ] ABHISHEK KUMAR GUPTA commented on SPARK-27003: -- Please update the doc for applicability of

[jira] [Updated] (SPARK-27004) Code for https uri authentication in Spark Submit needs to be updated

[ https://issues.apache.org/jira/browse/SPARK-27004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-27004: Description: This old code according to the comments

[jira] [Updated] (SPARK-27004) Code for https uri authentication in Spark Submit needs to be updated

[ https://issues.apache.org/jira/browse/SPARK-27004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-27004: Description: The old code in Spark Submit used for uri verification according to

[jira] [Assigned] (SPARK-27003) [Spark]Message display at console is not correct for spark.executor.instances

[ https://issues.apache.org/jira/browse/SPARK-27003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27003: Assignee: Apache Spark > [Spark]Message display at console is not correct for

[jira] [Assigned] (SPARK-27003) [Spark]Message display at console is not correct for spark.executor.instances

[ https://issues.apache.org/jira/browse/SPARK-27003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27003: Assignee: (was: Apache Spark) > [Spark]Message display at console is not correct for

[jira] [Updated] (SPARK-27004) Code for https uri authentication in Spark Submit needs to be removed

[ https://issues.apache.org/jira/browse/SPARK-27004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-27004: Summary: Code for https uri authentication in Spark Submit needs to be removed

[jira] [Updated] (SPARK-27004) Code for https uri authentication in Spark Submit needs to be updated

[ https://issues.apache.org/jira/browse/SPARK-27004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-27004: Description: This old code according to the comments

[jira] [Updated] (SPARK-27003) [Spark]Message display at console is not correct for spark.executor.instances

[ https://issues.apache.org/jira/browse/SPARK-27003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA updated SPARK-27003: - Attachment: Spark-JIRA-Executor-Msg.png > [Spark]Message display at console is

[jira] [Commented] (SPARK-27003) [Spark]Message display at console is not correct for spark.executor.instances

[ https://issues.apache.org/jira/browse/SPARK-27003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779341#comment-16779341 ] shahid commented on SPARK-27003: default value of spark.executor.instances=2 is applicable only for

[jira] [Created] (SPARK-27004) Code for https uri authentication in Spark Submit needs to be updated

Stavros Kontopoulos created SPARK-27004: --- Summary: Code for https uri authentication in Spark Submit needs to be updated Key: SPARK-27004 URL: https://issues.apache.org/jira/browse/SPARK-27004

[jira] [Updated] (SPARK-27004) Code for https uri authentication in Spark Submit needs to be updated

[ https://issues.apache.org/jira/browse/SPARK-27004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-27004: Priority: Minor (was: Major) > Code for https uri authentication in Spark Submit

[jira] [Updated] (SPARK-27003) [Spark]Message display at console is not correct for spark.executor.instances

[ https://issues.apache.org/jira/browse/SPARK-27003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA updated SPARK-27003: - Attachment: Spark-JIRA-Executor-Msg.png > [Spark]Message display at console is

[jira] [Updated] (SPARK-27003) [Spark]Message display at console is not correct for spark.executor.instances

[ https://issues.apache.org/jira/browse/SPARK-27003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA updated SPARK-27003: - Description: Steps: spark.executor.instances{color:#ff} not

[jira] [Updated] (SPARK-27003) [Spark]Message display at console is not correct for spark.executor.instances

[ https://issues.apache.org/jira/browse/SPARK-27003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA updated SPARK-27003: - Description: Steps: spark.executor.instances{color:#ff} not

[jira] [Created] (SPARK-27003) [Spark]Message display at console is not correct for spark.executor.instances

ABHISHEK KUMAR GUPTA created SPARK-27003: Summary: [Spark]Message display at console is not correct for spark.executor.instances Key: SPARK-27003 URL: https://issues.apache.org/jira/browse/SPARK-27003

[jira] [Commented] (SPARK-26996) Scalar Subquery not handled properly in Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-26996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779295#comment-16779295 ] Gengliang Wang commented on SPARK-26996: Thanks [~dongjoon]! > Scalar Subquery not handled

[jira] [Resolved] (SPARK-26902) Support java.time.Instant as an external type of TimestampType

[ https://issues.apache.org/jira/browse/SPARK-26902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-26902. - Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 3.0.0 > Support

[jira] [Commented] (SPARK-26764) [SPIP] Spark Relational Cache

[ https://issues.apache.org/jira/browse/SPARK-26764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779170#comment-16779170 ] Adrian Wang commented on SPARK-26764: - Hi [~Tagar] , the idea has something common with materialized

[jira] [Updated] (SPARK-27002) Latest kafka delegation token not always picked up

[ https://issues.apache.org/jira/browse/SPARK-27002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-27002: -- Description: Lately KAFKA-8004 has been discovered and this triggered me to do further tests

[jira] [Assigned] (SPARK-27002) Latest kafka delegation token not always picked up

[ https://issues.apache.org/jira/browse/SPARK-27002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27002: Assignee: Apache Spark > Latest kafka delegation token not always picked up >

[jira] [Assigned] (SPARK-27002) Latest kafka delegation token not always picked up

[ https://issues.apache.org/jira/browse/SPARK-27002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27002: Assignee: (was: Apache Spark) > Latest kafka delegation token not always picked up >

[jira] [Created] (SPARK-27002) Latest kafka delegation token not always picked up

Gabor Somogyi created SPARK-27002: - Summary: Latest kafka delegation token not always picked up Key: SPARK-27002 URL: https://issues.apache.org/jira/browse/SPARK-27002 Project: Spark Issue

[jira] [Updated] (SPARK-27002) Latest kafka delegation token not always picked up

[ https://issues.apache.org/jira/browse/SPARK-27002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-27002: -- Priority: Critical (was: Major) > Latest kafka delegation token not always picked up >

[jira] [Commented] (SPARK-26995) Running Spark in Docker image with Alpine Linux 3.9.0 throws errors when using snappy

[ https://issues.apache.org/jira/browse/SPARK-26995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779129#comment-16779129 ] Stijn De Haes commented on SPARK-26995: --- You can also add {code:java} ENV LD_LIBRARY_PATH

[jira] [Updated] (SPARK-26936) insert overwrite local directory can not create temporary path in local staging directory

[ https://issues.apache.org/jira/browse/SPARK-26936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-26936: --- Description: The feature is 'insert overwrite local directory' has an inconsistent behavior  with

[jira] [Updated] (SPARK-26936) insert overwrite local directory can not create temporary path in local staging directory

[ https://issues.apache.org/jira/browse/SPARK-26936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-26936: --- Description: The feature is 'insert overwrite local directory' has an inconsistent behavior  with

[jira] [Updated] (SPARK-26936) insert overwrite local directory can not create temporary path in local staging directory

[ https://issues.apache.org/jira/browse/SPARK-26936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-26936: --- Affects Version/s: 3.0.0 > insert overwrite local directory can not create temporary path in local

[jira] [Updated] (SPARK-26936) insert overwrite local directory can not create temporary path in local staging directory

[ https://issues.apache.org/jira/browse/SPARK-26936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-26936: --- Description: The feature is 'insert overwrite local directory' has an inconsistent behavior  with

[jira] [Updated] (SPARK-26936) insert overwrite local directory can not create temporary path in local staging directory

[ https://issues.apache.org/jira/browse/SPARK-26936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-26936: --- Description: The feature is 'insert overwrite local directory' has an inconsistent behavior  with

[jira] [Assigned] (SPARK-26449) Missing Dataframe.transform API in Python API

[ https://issues.apache.org/jira/browse/SPARK-26449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26449: - Assignee: Erik Christiansen (was: Hanan Shteingart) > Missing Dataframe.transform API in

[jira] [Resolved] (SPARK-26993) _minRegisteredRatio default value is zero not 0.8 for Yarn

[ https://issues.apache.org/jira/browse/SPARK-26993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yifan Guo resolved SPARK-26993. --- Resolution: Done > _minRegisteredRatio default value is zero not 0.8 for Yarn >

[jira] [Resolved] (SPARK-26999) SparkSQL CLIDriver parses sql statement incorrectly

[ https://issues.apache.org/jira/browse/SPARK-26999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang resolved SPARK-26999. - Resolution: Duplicate > SparkSQL CLIDriver parses sql statement incorrectly >

[jira] [Commented] (SPARK-27001) Refactor "serializerFor" method between ScalaReflection and JavaTypeInference

[ https://issues.apache.org/jira/browse/SPARK-27001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779026#comment-16779026 ] Jungtaek Lim commented on SPARK-27001: -- I'm working on it. > Refactor "serializerFor" method

[jira] [Created] (SPARK-27001) Refactor "serializerFor" method between ScalaReflection and JavaTypeInference

Jungtaek Lim created SPARK-27001: Summary: Refactor "serializerFor" method between ScalaReflection and JavaTypeInference Key: SPARK-27001 URL: https://issues.apache.org/jira/browse/SPARK-27001