[jira] [Created] (SPARK-26006) mllib Prefixspan

idan Levi created SPARK-26006: - Summary: mllib Prefixspan Key: SPARK-26006 URL: https://issues.apache.org/jira/browse/SPARK-26006 Project: Spark Issue Type: Bug Components: MLlib

[jira] [Commented] (SPARK-26007) DataFrameReader.csv() should respect to spark.sql.columnNameOfCorruptRecord

[ https://issues.apache.org/jira/browse/SPARK-26007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682856#comment-16682856 ] Apache Spark commented on SPARK-26007: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-26007) DataFrameReader.csv() should respect to spark.sql.columnNameOfCorruptRecord

[ https://issues.apache.org/jira/browse/SPARK-26007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682855#comment-16682855 ] Apache Spark commented on SPARK-26007: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-26007) DataFrameReader.csv() should respect to spark.sql.columnNameOfCorruptRecord

[ https://issues.apache.org/jira/browse/SPARK-26007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26007: Assignee: (was: Apache Spark) > DataFrameReader.csv() should respect to

[jira] [Assigned] (SPARK-26007) DataFrameReader.csv() should respect to spark.sql.columnNameOfCorruptRecord

[ https://issues.apache.org/jira/browse/SPARK-26007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26007: Assignee: Apache Spark > DataFrameReader.csv() should respect to

[jira] [Created] (SPARK-26005) Upgrade ANTRL to 4.7.1

Xiao Li created SPARK-26005: --- Summary: Upgrade ANTRL to 4.7.1 Key: SPARK-26005 URL: https://issues.apache.org/jira/browse/SPARK-26005 Project: Spark Issue Type: Bug Components: SQL

[jira] [Assigned] (SPARK-26005) Upgrade ANTRL to 4.7.1

[ https://issues.apache.org/jira/browse/SPARK-26005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26005: Assignee: Xiao Li (was: Apache Spark) > Upgrade ANTRL to 4.7.1 > --

[jira] [Assigned] (SPARK-26005) Upgrade ANTRL to 4.7.1

[ https://issues.apache.org/jira/browse/SPARK-26005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26005: Assignee: Apache Spark (was: Xiao Li) > Upgrade ANTRL to 4.7.1 > --

[jira] [Commented] (SPARK-26005) Upgrade ANTRL to 4.7.1

[ https://issues.apache.org/jira/browse/SPARK-26005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682799#comment-16682799 ] Apache Spark commented on SPARK-26005: -- User 'gatorsmile' has created a pull request for this

[jira] [Commented] (SPARK-26005) Upgrade ANTRL to 4.7.1

[ https://issues.apache.org/jira/browse/SPARK-26005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682800#comment-16682800 ] Apache Spark commented on SPARK-26005: -- User 'gatorsmile' has created a pull request for this

[jira] [Assigned] (SPARK-25972) Missed JSON options in streaming.py

[ https://issues.apache.org/jira/browse/SPARK-25972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25972: Assignee: Maxim Gekk > Missed JSON options in streaming.py >

[jira] [Created] (SPARK-26007) DataFrameReader.csv() should respect to spark.sql.columnNameOfCorruptRecord

Maxim Gekk created SPARK-26007: -- Summary: DataFrameReader.csv() should respect to spark.sql.columnNameOfCorruptRecord Key: SPARK-26007 URL: https://issues.apache.org/jira/browse/SPARK-26007 Project:

[jira] [Resolved] (SPARK-25972) Missed JSON options in streaming.py

[ https://issues.apache.org/jira/browse/SPARK-25972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25972. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22973

[jira] [Created] (SPARK-26008) Structured Streaming Manual clock for simulation

Tom Bar Yacov created SPARK-26008: - Summary: Structured Streaming Manual clock for simulation Key: SPARK-26008 URL: https://issues.apache.org/jira/browse/SPARK-26008 Project: Spark Issue

[jira] [Updated] (SPARK-25914) Separate projection from grouping and aggregate in logical Aggregate

[ https://issues.apache.org/jira/browse/SPARK-25914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25914: Target Version/s: 3.0.0 > Separate projection from grouping and aggregate in logical Aggregate >

[jira] [Commented] (SPARK-25914) Separate projection from grouping and aggregate in logical Aggregate

[ https://issues.apache.org/jira/browse/SPARK-25914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682890#comment-16682890 ] Hyukjin Kwon commented on SPARK-25914: -- Please avoid to set a target version which is usually

[jira] [Updated] (SPARK-25914) Separate projection from grouping and aggregate in logical Aggregate

[ https://issues.apache.org/jira/browse/SPARK-25914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25914: - Target Version/s: (was: 3.0.0) > Separate projection from grouping and aggregate in logical

[jira] [Resolved] (SPARK-19714) Clarify Bucketizer handling of invalid input

[ https://issues.apache.org/jira/browse/SPARK-19714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19714. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23003

[jira] [Commented] (SPARK-24421) Accessing sun.misc.Cleaner in JDK11

[ https://issues.apache.org/jira/browse/SPARK-24421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682915#comment-16682915 ] Assaf Mendelson commented on SPARK-24421: - Would it be possible to add {{Add-Opens

[jira] [Updated] (SPARK-24421) Accessing sun.misc.Cleaner in JDK11

[ https://issues.apache.org/jira/browse/SPARK-24421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-24421: -- Docs Text: Provisional release notes text: Spark 3 attempts to avoid the JVM's default limit on

[jira] [Created] (SPARK-26009) Unable to fetch jar from remote repo while running spark-submit on kubernetes

Bala Bharath Reddy Resapu created SPARK-26009: - Summary: Unable to fetch jar from remote repo while running spark-submit on kubernetes Key: SPARK-26009 URL:

[jira] [Updated] (SPARK-26011) pyspark app with "spark.jars.packages" config does not work

[ https://issues.apache.org/jira/browse/SPARK-26011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shanyu zhao updated SPARK-26011: Description: Command "pyspark --packages" works as expected, but if submitting a livy pyspark

[jira] [Commented] (SPARK-26011) pyspark app with "spark.jars.packages" config does not work

[ https://issues.apache.org/jira/browse/SPARK-26011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16683154#comment-16683154 ] Apache Spark commented on SPARK-26011: -- User 'shanyu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-26011) pyspark app with "spark.jars.packages" config does not work

[ https://issues.apache.org/jira/browse/SPARK-26011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26011: Assignee: (was: Apache Spark) > pyspark app with "spark.jars.packages" config does

[jira] [Assigned] (SPARK-26011) pyspark app with "spark.jars.packages" config does not work

[ https://issues.apache.org/jira/browse/SPARK-26011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26011: Assignee: Apache Spark > pyspark app with "spark.jars.packages" config does not work >

[jira] [Assigned] (SPARK-26012) Dynamic partition will fail when both '' and null values are taken as dynamic partition values simultaneously.

[ https://issues.apache.org/jira/browse/SPARK-26012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26012: Assignee: Apache Spark > Dynamic partition will fail when both '' and null values are

[jira] [Commented] (SPARK-26012) Dynamic partition will fail when both '' and null values are taken as dynamic partition values simultaneously.

[ https://issues.apache.org/jira/browse/SPARK-26012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16683217#comment-16683217 ] Apache Spark commented on SPARK-26012: -- User 'eatoncys' has created a pull request for this issue:

[jira] [Assigned] (SPARK-26012) Dynamic partition will fail when both '' and null values are taken as dynamic partition values simultaneously.

[ https://issues.apache.org/jira/browse/SPARK-26012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26012: Assignee: (was: Apache Spark) > Dynamic partition will fail when both '' and null

[jira] [Created] (SPARK-26013) Upgrade R tools version to 3.5.1 in AppVeyor build

Hyukjin Kwon created SPARK-26013: Summary: Upgrade R tools version to 3.5.1 in AppVeyor build Key: SPARK-26013 URL: https://issues.apache.org/jira/browse/SPARK-26013 Project: Spark Issue

[jira] [Updated] (SPARK-26012) Dynamic partition will fail when both '' and null values are taken as dynamic partition values simultaneously.

[ https://issues.apache.org/jira/browse/SPARK-26012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] eaton updated SPARK-26012: -- Description: Dynamic partition will fail when both '' and null values are taken as dynamic partition values

[jira] [Created] (SPARK-26011) pyspark app with "spark.jars.packages" config does not work

shanyu zhao created SPARK-26011: --- Summary: pyspark app with "spark.jars.packages" config does not work Key: SPARK-26011 URL: https://issues.apache.org/jira/browse/SPARK-26011 Project: Spark

[jira] [Assigned] (SPARK-26013) Upgrade R tools version to 3.5.1 in AppVeyor build

[ https://issues.apache.org/jira/browse/SPARK-26013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26013: Assignee: Apache Spark > Upgrade R tools version to 3.5.1 in AppVeyor build >

[jira] [Commented] (SPARK-26013) Upgrade R tools version to 3.5.1 in AppVeyor build

[ https://issues.apache.org/jira/browse/SPARK-26013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16683223#comment-16683223 ] Apache Spark commented on SPARK-26013: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-19761) create InMemoryFileIndex with empty rootPaths when set PARALLEL_PARTITION_DISCOVERY_THRESHOLD to zero

[ https://issues.apache.org/jira/browse/SPARK-19761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-19761. - Resolution: Fixed Fix Version/s: 2.2.0 > create InMemoryFileIndex with empty rootPaths

[jira] [Assigned] (SPARK-26013) Upgrade R tools version to 3.5.1 in AppVeyor build

[ https://issues.apache.org/jira/browse/SPARK-26013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26013: Assignee: (was: Apache Spark) > Upgrade R tools version to 3.5.1 in AppVeyor build >

[jira] [Commented] (SPARK-26013) Upgrade R tools version to 3.5.1 in AppVeyor build

[ https://issues.apache.org/jira/browse/SPARK-26013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16683221#comment-16683221 ] Apache Spark commented on SPARK-26013: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-26012) Dynamic partition will fail when both '' and null values are taken as dynamic partition values simultaneously.

eaton created SPARK-26012: - Summary: Dynamic partition will fail when both '' and null values are taken as dynamic partition values simultaneously. Key: SPARK-26012 URL: https://issues.apache.org/jira/browse/SPARK-26012

[jira] [Created] (SPARK-26014) Deprecate R < 3.4 support

Hyukjin Kwon created SPARK-26014: Summary: Deprecate R < 3.4 support Key: SPARK-26014 URL: https://issues.apache.org/jira/browse/SPARK-26014 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-19784) refresh datasource table after alter the location

[ https://issues.apache.org/jira/browse/SPARK-19784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16683246#comment-16683246 ] Apache Spark commented on SPARK-19784: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-26014) Deprecate R < 3.4 support

[ https://issues.apache.org/jira/browse/SPARK-26014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26014: Assignee: (was: Apache Spark) > Deprecate R < 3.4 support >

[jira] [Assigned] (SPARK-26014) Deprecate R < 3.4 support

[ https://issues.apache.org/jira/browse/SPARK-26014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26014: Assignee: Apache Spark > Deprecate R < 3.4 support > - > >

[jira] [Commented] (SPARK-26014) Deprecate R < 3.4 support

[ https://issues.apache.org/jira/browse/SPARK-26014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16683243#comment-16683243 ] Apache Spark commented on SPARK-26014: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-26005) Upgrade ANTRL to 4.7.1

[ https://issues.apache.org/jira/browse/SPARK-26005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-26005. - Resolution: Fixed Fix Version/s: 3.0.0 > Upgrade ANTRL to 4.7.1 > -- > >

[jira] [Commented] (SPARK-22674) PySpark breaks serialization of namedtuple subclasses

[ https://issues.apache.org/jira/browse/SPARK-22674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16683033#comment-16683033 ] Apache Spark commented on SPARK-22674: -- User 'superbobry' has created a pull request for this

[jira] [Updated] (SPARK-26010) SparkR vignette fails on CRAN on Java 11

[ https://issues.apache.org/jira/browse/SPARK-26010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26010: - Summary: SparkR vignette fails on CRAN on Java 11 (was: SparkR vignette fails on Java 11) >

[jira] [Assigned] (SPARK-26010) SparkR vignette fails on CRAN on Java 11

[ https://issues.apache.org/jira/browse/SPARK-26010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26010: Assignee: (was: Apache Spark) > SparkR vignette fails on CRAN on Java 11 >

[jira] [Assigned] (SPARK-26010) SparkR vignette fails on CRAN on Java 11

[ https://issues.apache.org/jira/browse/SPARK-26010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26010: Assignee: Apache Spark > SparkR vignette fails on CRAN on Java 11 >

[jira] [Commented] (SPARK-26010) SparkR vignette fails on CRAN on Java 11

[ https://issues.apache.org/jira/browse/SPARK-26010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682958#comment-16682958 ] Apache Spark commented on SPARK-26010: -- User 'felixcheung' has created a pull request for this

[jira] [Commented] (SPARK-26010) SparkR vignette fails on CRAN on Java 11

[ https://issues.apache.org/jira/browse/SPARK-26010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682959#comment-16682959 ] Apache Spark commented on SPARK-26010: -- User 'felixcheung' has created a pull request for this

[jira] [Comment Edited] (SPARK-24421) Accessing sun.misc.Cleaner in JDK11

[ https://issues.apache.org/jira/browse/SPARK-24421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682951#comment-16682951 ] Alan edited comment on SPARK-24421 at 11/11/18 6:13 PM: Sean: In the proposed

[jira] [Commented] (SPARK-24421) Accessing sun.misc.Cleaner in JDK11

[ https://issues.apache.org/jira/browse/SPARK-24421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682951#comment-16682951 ] Alan commented on SPARK-24421: -- Sean - In the proposed release note text you say that access to the

[jira] [Created] (SPARK-26010) SparkR vignette fails on Java 11

Felix Cheung created SPARK-26010: Summary: SparkR vignette fails on Java 11 Key: SPARK-26010 URL: https://issues.apache.org/jira/browse/SPARK-26010 Project: Spark Issue Type: Bug