[jira] [Commented] (SPARK-27538) sparksql could not start in jdk11, exception org.datanucleus.exceptions.NucleusException: The java type java.lang.Long (jdbc-type='', sql-type="") cant be mapped for t

[ https://issues.apache.org/jira/browse/SPARK-27538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822889#comment-16822889 ] Yuming Wang commented on SPARK-27538: - Support the JDK11 is still in progress: SPARK-24417 >

[jira] [Created] (SPARK-27538) sparksql could not start in jdk11, exception org.datanucleus.exceptions.NucleusException: The java type java.lang.Long (jdbc-type='', sql-type="") cant be mapped for thi

dingwei2019 created SPARK-27538: --- Summary: sparksql could not start in jdk11, exception org.datanucleus.exceptions.NucleusException: The java type java.lang.Long (jdbc-type='', sql-type="") cant be mapped for this datastore. No mapping is

[jira] [Updated] (SPARK-27537) spark-2.4.1/mlib-local/src/test/scala/org/apache/spark/ml/linalg/MatricesSuite.scala.866:Value size is not a member of Object

[ https://issues.apache.org/jira/browse/SPARK-27537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dingwei2019 updated SPARK-27537: Description: [ERROR]: [Error] 

[jira] [Comment Edited] (SPARK-27537) spark-2.4.1/mlib-local/src/test/scala/org/apache/spark/ml/linalg/MatricesSuite.scala.866:Value size is not a member of Object

[ https://issues.apache.org/jira/browse/SPARK-27537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822845#comment-16822845 ] dingwei2019 edited comment on SPARK-27537 at 4/22/19 3:15 AM: -- the question

[jira] [Commented] (SPARK-27537) spark-2.4.1/mlib-local/src/test/scala/org/apache/spark/ml/linalg/MatricesSuite.scala.866:Value size is not a member of Object

[ https://issues.apache.org/jira/browse/SPARK-27537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822845#comment-16822845 ] dingwei2019 commented on SPARK-27537: - the question is found in spark ml test module, althrough this

[jira] [Updated] (SPARK-27537) spark-2.4.1/mlib-local/src/test/scala/org/apache/spark/ml/linalg/MatricesSuite.scala.866:Value size is not a member of Object

[ https://issues.apache.org/jira/browse/SPARK-27537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dingwei2019 updated SPARK-27537: Docs Text: (was: the question is found in spark ml test module, althrough this is an test

[jira] [Created] (SPARK-27537) spark-2.4.1/mlib-local/src/test/scala/org/apache/spark/ml/linalg/MatricesSuite.scala.866:Value size is not a member of Object

dingwei2019 created SPARK-27537: --- Summary: spark-2.4.1/mlib-local/src/test/scala/org/apache/spark/ml/linalg/MatricesSuite.scala.866:Value size is not a member of Object Key: SPARK-27537 URL:

[jira] [Created] (SPARK-27536) Code improvements for 3.0: existentials edition

Sean Owen created SPARK-27536: - Summary: Code improvements for 3.0: existentials edition Key: SPARK-27536 URL: https://issues.apache.org/jira/browse/SPARK-27536 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-27496) RPC should send back the fatal errors

[ https://issues.apache.org/jira/browse/SPARK-27496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27496. --- Resolution: Fixed Fix Version/s: 2.4.3 3.0.0

[jira] [Commented] (SPARK-27512) Decimal parsing leads to unexpected type inference

[ https://issues.apache.org/jira/browse/SPARK-27512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822796#comment-16822796 ] koert kuipers commented on SPARK-27512: --- seems DecimalFormat.parse also simply ignores commas.

[jira] [Comment Edited] (SPARK-27512) Decimal parsing leads to unexpected type inference

[ https://issues.apache.org/jira/browse/SPARK-27512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822790#comment-16822790 ] koert kuipers edited comment on SPARK-27512 at 4/21/19 11:03 PM: -

[jira] [Commented] (SPARK-27512) Decimal parsing leads to unexpected type inference

[ https://issues.apache.org/jira/browse/SPARK-27512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822790#comment-16822790 ] koert kuipers commented on SPARK-27512: --- [~maxgekk] max do you know why getDecimalParser has that

[jira] [Commented] (SPARK-27513) Spark tarball with binaries should have files owned by uid 0

[ https://issues.apache.org/jira/browse/SPARK-27513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822789#comment-16822789 ] koert kuipers commented on SPARK-27513: --- i think this can be closed as wont fix > Spark tarball

[jira] [Updated] (SPARK-27480) Improve `EXPLAIN DESC QUERY` to show the input SQL statement

[ https://issues.apache.org/jira/browse/SPARK-27480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27480: -- Summary: Improve `EXPLAIN DESC QUERY` to show the input SQL statement (was: Improve explain

[jira] [Updated] (SPARK-27480) Improve explain output of describe query command to show the actual input query as opposed to a truncated logical plan.

[ https://issues.apache.org/jira/browse/SPARK-27480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27480: -- Issue Type: Improvement (was: Bug) > Improve explain output of describe query command to

[jira] [Resolved] (SPARK-27480) Improve `EXPLAIN DESC QUERY` to show the input SQL statement

[ https://issues.apache.org/jira/browse/SPARK-27480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27480. --- Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 3.0.0 This is

[jira] [Updated] (SPARK-27419) When setting spark.executor.heartbeatInterval to a value less than 1 seconds, it will always fail

[ https://issues.apache.org/jira/browse/SPARK-27419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27419: -- Labels: release-notes (was: ) > When setting spark.executor.heartbeatInterval to a value less than 1

[jira] [Updated] (SPARK-24601) Bump Jackson version to 2.9.6

[ https://issues.apache.org/jira/browse/SPARK-24601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-24601: -- Docs Text: Spark's Jackson dependency has been updated from 2.6.x to 2.9.x. User applications that

[jira] [Updated] (SPARK-24601) Bump Jackson version to 2.9.6

[ https://issues.apache.org/jira/browse/SPARK-24601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-24601: -- Labels: release-notes (was: ) > Bump Jackson version to 2.9.6 > - > >

[jira] [Updated] (SPARK-27274) Refer to Scala 2.12 in docs; deprecate Scala 2.11 support in 2.4.1

[ https://issues.apache.org/jira/browse/SPARK-27274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27274: -- Labels: release-notes (was: ) > Refer to Scala 2.12 in docs; deprecate Scala 2.11 support in 2.4.1 >

[jira] [Commented] (SPARK-27287) PCAModel.load() does not honor spark configs

[ https://issues.apache.org/jira/browse/SPARK-27287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822759#comment-16822759 ] Dharmesh Kakadia commented on SPARK-27287: -- [~mgaido] what do you mean by : use the

[jira] [Created] (SPARK-27535) Date and timestamp JSON benchmarks

Maxim Gekk created SPARK-27535: -- Summary: Date and timestamp JSON benchmarks Key: SPARK-27535 URL: https://issues.apache.org/jira/browse/SPARK-27535 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-27534) Do not load `content` column in binary data source if it is not selected

Xiangrui Meng created SPARK-27534: - Summary: Do not load `content` column in binary data source if it is not selected Key: SPARK-27534 URL: https://issues.apache.org/jira/browse/SPARK-27534 Project:

[jira] [Comment Edited] (SPARK-25348) Data source for binary files

[ https://issues.apache.org/jira/browse/SPARK-25348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818640#comment-16818640 ] Xiangrui Meng edited comment on SPARK-25348 at 4/21/19 7:49 PM: I

[jira] [Resolved] (SPARK-27473) Support filter push down for status fields in binary file data source

[ https://issues.apache.org/jira/browse/SPARK-27473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-27473. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24387

[jira] [Updated] (SPARK-27529) Spark Streaming consumer dies with kafka.common.OffsetOutOfRangeException

[ https://issues.apache.org/jira/browse/SPARK-27529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Goldenberg updated SPARK-27529: -- Description: We have a Spark Streaming consumer which at a certain point started

[jira] [Resolved] (SPARK-27439) Use analyzed plan when explaining Dataset

[ https://issues.apache.org/jira/browse/SPARK-27439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27439. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 3.0.0 This is

[jira] [Updated] (SPARK-27439) Use analyzed plan when explaining Dataset

[ https://issues.apache.org/jira/browse/SPARK-27439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27439: -- Description: {code} scala> spark.range(10).createOrReplaceTempView("test") scala>

[jira] [Updated] (SPARK-27439) Use analyzed plan when explaining Dataset

[ https://issues.apache.org/jira/browse/SPARK-27439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27439: -- Issue Type: Improvement (was: Bug) > Use analyzed plan when explaining Dataset >

[jira] [Updated] (SPARK-27439) Use analyzed plan when explaining Dataset

[ https://issues.apache.org/jira/browse/SPARK-27439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27439: -- Summary: Use analyzed plan when explaining Dataset (was: Explain result should match

[jira] [Updated] (SPARK-27439) Explain result should match collected result after view change

[ https://issues.apache.org/jira/browse/SPARK-27439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27439: -- Priority: Minor (was: Major) > Explain result should match collected result after view

[jira] [Updated] (SPARK-27439) Explain result should match collected result after view change

[ https://issues.apache.org/jira/browse/SPARK-27439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27439: -- Summary: Explain result should match collected result after view change (was:

[jira] [Updated] (SPARK-27051) Bump Jackson version to 2.9.8

[ https://issues.apache.org/jira/browse/SPARK-27051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27051: -- Fix Version/s: 2.4.3 > Bump Jackson version to 2.9.8 > - > >

[jira] [Assigned] (SPARK-24601) Bump Jackson version to 2.9.6

[ https://issues.apache.org/jira/browse/SPARK-24601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-24601: - Assignee: Fokko Driesprong > Bump Jackson version to 2.9.6 >

[jira] [Updated] (SPARK-24601) Bump Jackson version to 2.9.6

[ https://issues.apache.org/jira/browse/SPARK-24601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24601: -- Fix Version/s: 2.4.3 > Bump Jackson version to 2.9.6 > - > >

[jira] [Commented] (SPARK-27367) Faster RoaringBitmap Serialization with v0.8.0

[ https://issues.apache.org/jira/browse/SPARK-27367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822724#comment-16822724 ] Liang-Chi Hsieh commented on SPARK-27367: - I changed spark code to use the new API when

[jira] [Updated] (SPARK-27533) Date and timestamp CSV benchmarks

[ https://issues.apache.org/jira/browse/SPARK-27533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27533: --- Summary: Date and timestamp CSV benchmarks (was: Date/timestamps CSV benchmarks) > Date and

[jira] [Created] (SPARK-27533) CSV benchmarks date/timestamp ops

Maxim Gekk created SPARK-27533: -- Summary: CSV benchmarks date/timestamp ops Key: SPARK-27533 URL: https://issues.apache.org/jira/browse/SPARK-27533 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-27533) Date/timestamps CSV benchmarks

[ https://issues.apache.org/jira/browse/SPARK-27533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27533: --- Summary: Date/timestamps CSV benchmarks (was: CSV benchmarks date/timestamp ops ) >

[jira] [Resolved] (SPARK-27532) Correct the default value in the Documentation for "spark.redaction.regex"

[ https://issues.apache.org/jira/browse/SPARK-27532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27532. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24428

[jira] [Assigned] (SPARK-27532) Correct the default value in the Documentation for "spark.redaction.regex"

[ https://issues.apache.org/jira/browse/SPARK-27532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-27532: Assignee: Shivu Sondur > Correct the default value in the Documentation for

[jira] [Resolved] (SPARK-27527) Improve description of Timestamp and Date types

[ https://issues.apache.org/jira/browse/SPARK-27527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27527. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24424

[jira] [Assigned] (SPARK-27527) Improve description of Timestamp and Date types

[ https://issues.apache.org/jira/browse/SPARK-27527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-27527: Assignee: Maxim Gekk > Improve description of Timestamp and Date types >

[jira] [Updated] (SPARK-27526) Driver OOM error occurs while writing parquet file with Append mode

[ https://issues.apache.org/jira/browse/SPARK-27526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] senyoung updated SPARK-27526: - Labels: oom (was: easyfix oom) > Driver OOM error occurs while writing parquet file with Append mode >

[jira] [Updated] (SPARK-27526) Driver OOM error occurs while writing parquet file with Append mode

[ https://issues.apache.org/jira/browse/SPARK-27526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] senyoung updated SPARK-27526: - Labels: easyfix oom (was: easyfix) > Driver OOM error occurs while writing parquet file with Append