[jira] [Updated] (SPARK-28724) Throw error message when cast out range decimal to long

[ https://issues.apache.org/jira/browse/SPARK-28724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShuMing Li updated SPARK-28724: --- Description: Maybe this is a bug in `Scala` when convert `BigDecimal` to `Long`, however Spark

[jira] [Commented] (SPARK-28696) create database _; allowing in Spark but Hive throws Parse Exception

[ https://issues.apache.org/jira/browse/SPARK-28696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906881#comment-16906881 ] Ajith S commented on SPARK-28696: - [~hyukjin.kwon] okay, should we disallow tables names starting with _

[jira] [Commented] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906873#comment-16906873 ] Sujith Chacko commented on SPARK-28707: --- [~angerszhuuu] [~dongjoon] thanks a lot for the

[jira] [Commented] (SPARK-28636) Thriftserver can not support decimal type with negative scale

[ https://issues.apache.org/jira/browse/SPARK-28636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906868#comment-16906868 ] Shivu Sondur commented on SPARK-28636: -- I checked this issue, it looks like Hive side changes

[jira] [Created] (SPARK-28724) Throw error message when cast out range decimal to long

ShuMing Li created SPARK-28724: -- Summary: Throw error message when cast out range decimal to long Key: SPARK-28724 URL: https://issues.apache.org/jira/browse/SPARK-28724 Project: Spark Issue

[jira] [Commented] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906840#comment-16906840 ] Hyukjin Kwon commented on SPARK-28681: -- [~bzhang], can you show the reproducer including bash

[jira] [Commented] (SPARK-23793) Handle database names in spark.udf.register()

[ https://issues.apache.org/jira/browse/SPARK-23793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906824#comment-16906824 ] bernie huang commented on SPARK-23793: -- Is anyone following up on this improvement? > Handle

[jira] [Assigned] (SPARK-28723) Upgrade to Hive 2.3.6 for HiveMetastore Client and Hadoop-3.2 profile

[ https://issues.apache.org/jira/browse/SPARK-28723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28723: - Assignee: Yuming Wang > Upgrade to Hive 2.3.6 for HiveMetastore Client and Hadoop-3.2

[jira] [Created] (SPARK-28723) Upgrade to Hive 2.3.6 for HiveMetastore Client and Hadoop-3.2 profile

Dongjoon Hyun created SPARK-28723: - Summary: Upgrade to Hive 2.3.6 for HiveMetastore Client and Hadoop-3.2 profile Key: SPARK-28723 URL: https://issues.apache.org/jira/browse/SPARK-28723 Project:

[jira] [Updated] (SPARK-28723) Upgrade to Hive 2.3.6 for HiveMetastore Client and Hadoop-3.2 profile

[ https://issues.apache.org/jira/browse/SPARK-28723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28723: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-24417 > Upgrade to Hive 2.3.6

[jira] [Commented] (SPARK-23793) Handle database names in spark.udf.register()

[ https://issues.apache.org/jira/browse/SPARK-23793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906805#comment-16906805 ] yangyiwan commented on SPARK-23793: --- _spark.udf.register("testdb.testfunc", (a: Int) => a + 1)_

[jira] [Resolved] (SPARK-28487) K8S pod allocator behaves poorly with dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-28487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28487. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25236

[jira] [Assigned] (SPARK-28487) K8S pod allocator behaves poorly with dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-28487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28487: -- Assignee: Marcelo Vanzin > K8S pod allocator behaves poorly with dynamic allocation

[jira] [Created] (SPARK-28722) Change sequential label sorting in StringIndexer fit to parallel

Liang-Chi Hsieh created SPARK-28722: --- Summary: Change sequential label sorting in StringIndexer fit to parallel Key: SPARK-28722 URL: https://issues.apache.org/jira/browse/SPARK-28722 Project:

[jira] [Commented] (SPARK-19653) `Vector` Type Should Be A First-Class Citizen In Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-19653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906751#comment-16906751 ] Tanmay Binaykiya commented on SPARK-19653: -- What is the status of this?  > `Vector` Type

[jira] [Assigned] (SPARK-27768) Infinity, -Infinity, NaN should be recognized in a case insensitive manner

[ https://issues.apache.org/jira/browse/SPARK-27768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-27768: - Assignee: Dilip Biswal > Infinity, -Infinity, NaN should be recognized in a case

[jira] [Resolved] (SPARK-27768) Infinity, -Infinity, NaN should be recognized in a case insensitive manner

[ https://issues.apache.org/jira/browse/SPARK-27768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27768. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25331

[jira] [Created] (SPARK-28721) Failing to stop SparkSession in K8S cluster mode PySpark leaks Driver and Executors

Patrick Clay created SPARK-28721: Summary: Failing to stop SparkSession in K8S cluster mode PySpark leaks Driver and Executors Key: SPARK-28721 URL: https://issues.apache.org/jira/browse/SPARK-28721

[jira] [Updated] (SPARK-28712) spark structured stream with kafka don't really delete temp files in spark standalone cluster

[ https://issues.apache.org/jira/browse/SPARK-28712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 凭落 updated SPARK-28712: --- Environment: redhat 7 jdk 1.8 scala 2.11.12 spark standalone cluster 2.4.3 kafka 0.10.2.1   was: redhat 7

[jira] [Updated] (SPARK-28713) Bump checkstyle from 8.14 to 8.23

[ https://issues.apache.org/jira/browse/SPARK-28713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28713: -- Fix Version/s: 2.4.4 > Bump checkstyle from 8.14 to 8.23 > -

[jira] [Resolved] (SPARK-28720) Update AppVeyor R version to 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-28720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-28720. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25441

[jira] [Resolved] (SPARK-28719) Enable Github Actions for building master

[ https://issues.apache.org/jira/browse/SPARK-28719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-28719. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25440

[jira] [Resolved] (SPARK-28700) make_timestamp loses seconds fractions

[ https://issues.apache.org/jira/browse/SPARK-28700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28700. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25421

[jira] [Assigned] (SPARK-28700) make_timestamp loses seconds fractions

[ https://issues.apache.org/jira/browse/SPARK-28700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28700: - Assignee: Maxim Gekk > make_timestamp loses seconds fractions >

[jira] [Resolved] (SPARK-28718) Support field synonyms at `extract`

[ https://issues.apache.org/jira/browse/SPARK-28718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28718. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25438

[jira] [Assigned] (SPARK-28718) Support field synonyms at `extract`

[ https://issues.apache.org/jira/browse/SPARK-28718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28718: - Assignee: Maxim Gekk > Support field synonyms at `extract` >

[jira] [Updated] (SPARK-28720) Update AppVeyor R version to 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-28720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28720: -- Issue Type: Improvement (was: Task) > Update AppVeyor R version to 3.6.1 >

[jira] [Updated] (SPARK-28720) Update AppVeyor R version to 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-28720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28720: -- Component/s: (was: R) SparkR > Update AppVeyor R version to 3.6.1 >

[jira] [Updated] (SPARK-28720) Update AppVeyor R version to 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-28720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28720: -- Issue Type: Test (was: Improvement) > Update AppVeyor R version to 3.6.1 >

[jira] [Updated] (SPARK-28720) Update AppVeyor R version to 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-28720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28720: -- Issue Type: Task (was: Test) > Update AppVeyor R version to 3.6.1 >

[jira] [Created] (SPARK-28720) Update AppVeyor R version to 3.6.1

Dongjoon Hyun created SPARK-28720: - Summary: Update AppVeyor R version to 3.6.1 Key: SPARK-28720 URL: https://issues.apache.org/jira/browse/SPARK-28720 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-28701) add java11 support for spark pull request builds

[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906660#comment-16906660 ] Dongjoon Hyun edited comment on SPARK-28701 at 8/13/19 10:08 PM: - BTW,

[jira] [Commented] (SPARK-28701) add java11 support for spark pull request builds

[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906660#comment-16906660 ] Dongjoon Hyun commented on SPARK-28701: --- BTW, [~shaneknapp]. Jenkins script seems to be broken now

[jira] [Commented] (SPARK-28701) add java11 support for spark pull request builds

[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906654#comment-16906654 ] Dongjoon Hyun commented on SPARK-28701: --- Hi, [~shaneknapp]. For JDK11, during last two days, we

[jira] [Commented] (SPARK-27318) Join operation on bucketing table fails with base adaptive enabled

[ https://issues.apache.org/jira/browse/SPARK-27318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906648#comment-16906648 ] Jenny Liu commented on SPARK-27318: --- Is there an update about this issue?  What does the error

[jira] [Created] (SPARK-28719) Enable Github Actions for building master

DB Tsai created SPARK-28719: --- Summary: Enable Github Actions for building master Key: SPARK-28719 URL: https://issues.apache.org/jira/browse/SPARK-28719 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28707. --- Resolution: Not A Problem > Spark SQL select query result size issue >

[jira] [Commented] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906624#comment-16906624 ] Dongjoon Hyun commented on SPARK-28707: --- I don't think this is a bug `maxResultSize` doesn't mean

[jira] [Commented] (SPARK-28701) add java11 support for spark pull request builds

[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906618#comment-16906618 ] shane knapp commented on SPARK-28701: - excellent. this is useful... thanks! > add java11 support

[jira] [Commented] (SPARK-28701) add java11 support for spark pull request builds

[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906613#comment-16906613 ] Sean Owen commented on SPARK-28701: --- I'm pretty sure the consensus is: support Java 8 for a while to

[jira] [Commented] (SPARK-28701) add java11 support for spark pull request builds

[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906609#comment-16906609 ] shane knapp commented on SPARK-28701: - [~srowen] [~hyukjin.kwon] [~dongjoon] what is the roadmap

[jira] [Created] (SPARK-28718) Support field synonyms at `extract`

Maxim Gekk created SPARK-28718: -- Summary: Support field synonyms at `extract` Key: SPARK-28718 URL: https://issues.apache.org/jira/browse/SPARK-28718 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-28708) IsolatedClientLoader will not load hive classes from application jars

[ https://issues.apache.org/jira/browse/SPARK-28708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28708. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25429

[jira] [Updated] (SPARK-28717) Update SQL ALTER TABLE RENAME to use TableCatalog#renameTable operation

[ https://issues.apache.org/jira/browse/SPARK-28717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edgar Rodriguez updated SPARK-28717: Summary: Update SQL ALTER TABLE RENAME to use TableCatalog#renameTable operation (was:

[jira] [Assigned] (SPARK-28708) IsolatedClientLoader will not load hive classes from application jars

[ https://issues.apache.org/jira/browse/SPARK-28708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28708: - Assignee: Yuming Wang > IsolatedClientLoader will not load hive classes from

[jira] [Updated] (SPARK-28717) Update SQL ALTER TABLE RENAME to use TableCatalog API

[ https://issues.apache.org/jira/browse/SPARK-28717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edgar Rodriguez updated SPARK-28717: Summary: Update SQL ALTER TABLE RENAME to use TableCatalog API (was: Update SQL ALTER

[jira] [Created] (SPARK-28717) Update SQL TABLE RENAME to use TableCatalog#renameTable operation

Edgar Rodriguez created SPARK-28717: --- Summary: Update SQL TABLE RENAME to use TableCatalog#renameTable operation Key: SPARK-28717 URL: https://issues.apache.org/jira/browse/SPARK-28717 Project:

[jira] [Commented] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906486#comment-16906486 ] Brian Zhang commented on SPARK-28681: - Thanks [~Udbhav Agrawal], I see where the difference is. In

[jira] [Resolved] (SPARK-28713) Bump checkstyle from 8.14 to 8.23

[ https://issues.apache.org/jira/browse/SPARK-28713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28713. --- Resolution: Fixed Fix Version/s: 3.0.0 This is resolved via

[jira] [Commented] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906425#comment-16906425 ] Udbhav Agrawal commented on SPARK-28681: #Detailed Table Information Database

[jira] [Commented] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906417#comment-16906417 ] Brian Zhang commented on SPARK-28681: - Hi [~Udbhav Agrawal], Double checking, is your table an ORC

[jira] [Updated] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal updated SPARK-28681: --- Attachment: Screenshot from 2019-08-13 22-01-04.png > Spark SQL unable to read Hive ORC

[jira] [Commented] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906384#comment-16906384 ] Udbhav Agrawal commented on SPARK-28681: !Screenshot from 2019-08-13 22-01-04.png! > Spark SQL

[jira] [Comment Edited] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906381#comment-16906381 ] Udbhav Agrawal edited comment on SPARK-28681 at 8/13/19 4:40 PM: -  

[jira] [Comment Edited] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906381#comment-16906381 ] Udbhav Agrawal edited comment on SPARK-28681 at 8/13/19 4:37 PM: -  

[jira] [Commented] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906381#comment-16906381 ] Udbhav Agrawal commented on SPARK-28681: !Screenshot from 2019-08-13 22-01-04.png! [~bzhang]

[jira] [Updated] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal updated SPARK-28681: --- Attachment: Screenshot from 2019-08-13 22-01-04.png > Spark SQL unable to read Hive ORC

[jira] [Updated] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal updated SPARK-28681: --- Attachment: (was: Screenshot from 2019-08-13 22-01-04.png) > Spark SQL unable to read

[jira] [Updated] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal updated SPARK-28681: --- Attachment: Screenshot from 2019-08-13 22-01-04.png > Spark SQL unable to read Hive ORC

[jira] [Updated] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal updated SPARK-28681: --- Attachment: (was: Screenshot from 2019-08-13 22-01-04.png) > Spark SQL unable to read

[jira] [Assigned] (SPARK-28714) Add test for spark-sql support hive.aux.jars.path

[ https://issues.apache.org/jira/browse/SPARK-28714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28714: - Assignee: Yuming Wang > Add test for spark-sql support hive.aux.jars.path >

[jira] [Resolved] (SPARK-28714) Add test for spark-sql support hive.aux.jars.path

[ https://issues.apache.org/jira/browse/SPARK-28714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28714. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25435

[jira] [Commented] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906367#comment-16906367 ] Hyukjin Kwon commented on SPARK-28681: -- Actually I resolved given [~Udbhav Agrawal]'s test.

[jira] [Updated] (SPARK-28713) Bump checkstyle from 8.14 to 8.23

[ https://issues.apache.org/jira/browse/SPARK-28713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28713: -- Summary: Bump checkstyle from 8.14 to 8.23 (was: Bump checkstyle from 8.14 to 8.18) > Bump

[jira] [Assigned] (SPARK-28713) Bump checkstyle from 8.14 to 8.23

[ https://issues.apache.org/jira/browse/SPARK-28713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28713: - Assignee: Fokko Driesprong > Bump checkstyle from 8.14 to 8.23 >

[jira] [Commented] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906362#comment-16906362 ] Brian Zhang commented on SPARK-28681: - Hi [~Udbhav Agrawal], I'm a bit confused here, based on

[jira] [Resolved] (SPARK-28422) GROUPED_AGG pandas_udf doesn't with spark.sql() without group by clause

[ https://issues.apache.org/jira/browse/SPARK-28422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28422. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25352

[jira] [Assigned] (SPARK-28422) GROUPED_AGG pandas_udf doesn't with spark.sql() without group by clause

[ https://issues.apache.org/jira/browse/SPARK-28422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28422: Assignee: Liang-Chi Hsieh > GROUPED_AGG pandas_udf doesn't with spark.sql() without

[jira] [Updated] (SPARK-28716) Add id to Exchange and Subquery's stringArgs method for easier identifying their reuses in query plans

[ https://issues.apache.org/jira/browse/SPARK-28716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-28716: - Description: Add id to Exchange and Subquery's stringArgs method for easier identifying their

[jira] [Updated] (SPARK-28716) Add id to Exchange and Subquery's stringArgs method for easier identifying their reuses in query plans

[ https://issues.apache.org/jira/browse/SPARK-28716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-28716: - Description: Add id to Exchange and Subquery's stringArgs method for easier identifying their

[jira] [Updated] (SPARK-28716) Add id to Exchange and Subquery's stringArgs method for easier identifying their reuses in query plans

[ https://issues.apache.org/jira/browse/SPARK-28716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-28716: - Description: Add id to Exchange and Subquery's stringArgs method for easier identifying their

[jira] [Created] (SPARK-28716) Add id to Exchange and Subquery's stringArgs method for easier identifying their reuses in query plans

Ali Afroozeh created SPARK-28716: Summary: Add id to Exchange and Subquery's stringArgs method for easier identifying their reuses in query plans Key: SPARK-28716 URL:

[jira] [Updated] (SPARK-28714) Add test for spark-sql support hive.aux.jars.path

[ https://issues.apache.org/jira/browse/SPARK-28714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28714: Description: {{Utilities.addToClassPath}} was removed since HIVE-21584 and we will backport that

[jira] [Updated] (SPARK-28714) Add test for spark-sql support hive.aux.jars.path

[ https://issues.apache.org/jira/browse/SPARK-28714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28714: Description: Utilities.addToClassPath was removed since HIVE-21584 and we will back it to our

[jira] [Updated] (SPARK-28715) Introduce collectInPlanAndSubqueries and subqueriesAll in QueryPlan

[ https://issues.apache.org/jira/browse/SPARK-28715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-28715: - Summary: Introduce collectInPlanAndSubqueries and subqueriesAll in QueryPlan (was: Introduce

[jira] [Created] (SPARK-28715) Introduce `collectInPlanAndSubqueries` and `subqueriesAll` in `QueryPlan`

Ali Afroozeh created SPARK-28715: Summary: Introduce `collectInPlanAndSubqueries` and `subqueriesAll` in `QueryPlan` Key: SPARK-28715 URL: https://issues.apache.org/jira/browse/SPARK-28715 Project:

[jira] [Created] (SPARK-28714) Add test for spark-sql support hive.aux.jars.path

Yuming Wang created SPARK-28714: --- Summary: Add test for spark-sql support hive.aux.jars.path Key: SPARK-28714 URL: https://issues.apache.org/jira/browse/SPARK-28714 Project: Spark Issue Type:

[jira] [Updated] (SPARK-28709) Memory leaks after stopping of StreamingContext

[ https://issues.apache.org/jira/browse/SPARK-28709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikita Gorbachevski updated SPARK-28709: Description: In my application spark streaming is restarted programmatically by

[jira] [Created] (SPARK-28713) Bump checkstyle from 8.14 to 8.18

Fokko Driesprong created SPARK-28713: Summary: Bump checkstyle from 8.14 to 8.18 Key: SPARK-28713 URL: https://issues.apache.org/jira/browse/SPARK-28713 Project: Spark Issue Type: Task

[jira] [Comment Edited] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906265#comment-16906265 ] angerszhu edited comment on SPARK-28707 at 8/13/19 2:34 PM: [~S71955] In

[jira] [Commented] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906265#comment-16906265 ] angerszhu commented on SPARK-28707: --- [~S71955] In case Limit , # it will take(n) of  each

[jira] [Commented] (SPARK-23151) Provide a distribution of Spark with Hadoop 3.0

[ https://issues.apache.org/jira/browse/SPARK-23151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906218#comment-16906218 ] Thomas Graves commented on SPARK-23151: --- Hey so for the hadoop-3.2 profile, the dependencies are

[jira] [Created] (SPARK-28712) spark structured stream with kafka don't really delete temp files in spark standalone cluster

凭落 created SPARK-28712: -- Summary: spark structured stream with kafka don't really delete temp files in spark standalone cluster Key: SPARK-28712 URL: https://issues.apache.org/jira/browse/SPARK-28712 Project:

[jira] [Commented] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906187#comment-16906187 ] Sujith Chacko commented on SPARK-28707: --- [~angerszhuuu]  In case of limit as you told data will be

[jira] [Commented] (SPARK-28710) [UDF] create or replace permanent function does not clear the jar in class path

[ https://issues.apache.org/jira/browse/SPARK-28710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906180#comment-16906180 ] Sandeep Katta commented on SPARK-28710: --- cc [~dongjoon] [~hyukjin.kwon]  requires your suggestion

[jira] [Resolved] (SPARK-28698) Allow user-specified output schema in function `to_avro`

[ https://issues.apache.org/jira/browse/SPARK-28698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28698. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25419

[jira] [Assigned] (SPARK-28698) Allow user-specified output schema in function `to_avro`

[ https://issues.apache.org/jira/browse/SPARK-28698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28698: --- Assignee: Gengliang Wang > Allow user-specified output schema in function `to_avro` >

[jira] [Resolved] (SPARK-28706) Allow upcast from null type to any types

[ https://issues.apache.org/jira/browse/SPARK-28706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28706. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25425

[jira] [Created] (SPARK-28711) [SQL] ThriftServer is not starting after upgrading the spark to 3.0

Sandeep Katta created SPARK-28711: - Summary: [SQL] ThriftServer is not starting after upgrading the spark to 3.0 Key: SPARK-28711 URL: https://issues.apache.org/jira/browse/SPARK-28711 Project: Spark

[jira] [Created] (SPARK-28710) [UDF] create or replace permanent function does not clear the jar in class path

ABHISHEK KUMAR GUPTA created SPARK-28710: Summary: [UDF] create or replace permanent function does not clear the jar in class path Key: SPARK-28710 URL: https://issues.apache.org/jira/browse/SPARK-28710

[jira] [Commented] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906080#comment-16906080 ] Sujith Chacko commented on SPARK-28707: --- In both case the result size shall be 1000,  In case of

[jira] [Commented] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906076#comment-16906076 ] angerszhu commented on SPARK-28707: --- When we call a limit, it will change to a SinglePartition, it

[jira] [Updated] (SPARK-28709) Memory leaks after stopping of StreamingContext

[ https://issues.apache.org/jira/browse/SPARK-28709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikita Gorbachevski updated SPARK-28709: Description: In my application spark streaming is restarted programmatically by

[jira] [Created] (SPARK-28709) Memory leaks after stopping of StreamingContext

Nikita Gorbachevski created SPARK-28709: --- Summary: Memory leaks after stopping of StreamingContext Key: SPARK-28709 URL: https://issues.apache.org/jira/browse/SPARK-28709 Project: Spark

[jira] [Commented] (SPARK-28373) Document JDBC/ODBC Server page

[ https://issues.apache.org/jira/browse/SPARK-28373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905991#comment-16905991 ] Yuming Wang commented on SPARK-28373: - Thank you [~podongfeng] Could you take this over. I'm very

[jira] [Commented] (SPARK-28543) Document Spark Jobs page

[ https://issues.apache.org/jira/browse/SPARK-28543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905988#comment-16905988 ] Pablo Langa Blanco commented on SPARK-28543: Hi [~podongfeng], i have seen it when i do the

[jira] [Commented] (SPARK-28373) Document JDBC/ODBC Server page

[ https://issues.apache.org/jira/browse/SPARK-28373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905937#comment-16905937 ] zhengruifeng commented on SPARK-28373: -- [~yumwang]  I had just create a page in

[jira] [Commented] (SPARK-28543) Document Spark Jobs page

[ https://issues.apache.org/jira/browse/SPARK-28543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905935#comment-16905935 ] zhengruifeng commented on SPARK-28543: -- [~planga82] I had just create a page in

[jira] [Resolved] (SPARK-27662) SQL tab shows two jobs for one SQL command

[ https://issues.apache.org/jira/browse/SPARK-27662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-27662. - Resolution: Invalid > SQL tab shows two jobs for one SQL command >

[jira] [Created] (SPARK-28708) IsolatedClientLoader will not load hive classes from application jars

Yuming Wang created SPARK-28708: --- Summary: IsolatedClientLoader will not load hive classes from application jars Key: SPARK-28708 URL: https://issues.apache.org/jira/browse/SPARK-28708 Project: Spark

  1   2   >