[jira] [Created] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

angerszhu created SPARK-28726: - Summary: Spark with DynamicAllocation always got connect rest by peers Key: SPARK-28726 URL: https://issues.apache.org/jira/browse/SPARK-28726 Project: Spark Issu

[jira] [Created] (SPARK-28725) Spark ML not able to de-serialize Logistic Regression model saved in previous version of Spark

Sharad Varshney created SPARK-28725: --- Summary: Spark ML not able to de-serialize Logistic Regression model saved in previous version of Spark Key: SPARK-28725 URL: https://issues.apache.org/jira/browse/SPARK-287

[jira] [Assigned] (SPARK-28265) Missing TableCatalog API to rename table

[ https://issues.apache.org/jira/browse/SPARK-28265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28265: --- Assignee: Edgar Rodriguez > Missing TableCatalog API to rename table >

[jira] [Resolved] (SPARK-28711) [SQL] ThriftServer is not starting after upgrading the spark to 3.0

[ https://issues.apache.org/jira/browse/SPARK-28711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Katta resolved SPARK-28711. --- Resolution: Not A Bug > [SQL] ThriftServer is not starting after upgrading the spark to 3.0

[jira] [Resolved] (SPARK-28265) Missing TableCatalog API to rename table

[ https://issues.apache.org/jira/browse/SPARK-28265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28265. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25206 [https://gith

[jira] [Updated] (SPARK-28724) Throw error message when cast out range decimal to long

[ https://issues.apache.org/jira/browse/SPARK-28724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShuMing Li updated SPARK-28724: --- Description: Maybe this is a bug in `Scala` when convert `BigDecimal` to `Long`, however Spark shou

[jira] [Commented] (SPARK-28696) create database _; allowing in Spark but Hive throws Parse Exception

[ https://issues.apache.org/jira/browse/SPARK-28696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906881#comment-16906881 ] Ajith S commented on SPARK-28696: - [~hyukjin.kwon] okay, should we disallow tables names

[jira] [Commented] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906873#comment-16906873 ] Sujith Chacko commented on SPARK-28707: --- [~angerszhuuu] [~dongjoon] thanks a lot f

[jira] [Commented] (SPARK-28636) Thriftserver can not support decimal type with negative scale

[ https://issues.apache.org/jira/browse/SPARK-28636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906868#comment-16906868 ] Shivu Sondur commented on SPARK-28636: -- I checked this issue, it looks like Hive si

[jira] [Created] (SPARK-28724) Throw error message when cast out range decimal to long

ShuMing Li created SPARK-28724: -- Summary: Throw error message when cast out range decimal to long Key: SPARK-28724 URL: https://issues.apache.org/jira/browse/SPARK-28724 Project: Spark Issue Typ

[jira] [Commented] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906840#comment-16906840 ] Hyukjin Kwon commented on SPARK-28681: -- [~bzhang], can you show the reproducer incl

[jira] [Commented] (SPARK-23793) Handle database names in spark.udf.register()

[ https://issues.apache.org/jira/browse/SPARK-23793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906824#comment-16906824 ] bernie huang commented on SPARK-23793: -- Is anyone following up on this improvement?

[jira] [Assigned] (SPARK-28723) Upgrade to Hive 2.3.6 for HiveMetastore Client and Hadoop-3.2 profile

[ https://issues.apache.org/jira/browse/SPARK-28723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28723: - Assignee: Yuming Wang > Upgrade to Hive 2.3.6 for HiveMetastore Client and Hadoop-3.2 p

[jira] [Created] (SPARK-28723) Upgrade to Hive 2.3.6 for HiveMetastore Client and Hadoop-3.2 profile

Dongjoon Hyun created SPARK-28723: - Summary: Upgrade to Hive 2.3.6 for HiveMetastore Client and Hadoop-3.2 profile Key: SPARK-28723 URL: https://issues.apache.org/jira/browse/SPARK-28723 Project: Spar

[jira] [Updated] (SPARK-28723) Upgrade to Hive 2.3.6 for HiveMetastore Client and Hadoop-3.2 profile

[ https://issues.apache.org/jira/browse/SPARK-28723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28723: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-24417 > Upgrade to Hive 2.3.6 f

[jira] [Commented] (SPARK-23793) Handle database names in spark.udf.register()

[ https://issues.apache.org/jira/browse/SPARK-23793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906805#comment-16906805 ] yangyiwan commented on SPARK-23793: --- _spark.udf.register("testdb.testfunc", (a: Int) =

[jira] [Resolved] (SPARK-28487) K8S pod allocator behaves poorly with dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-28487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28487. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25236 [https:

[jira] [Assigned] (SPARK-28487) K8S pod allocator behaves poorly with dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-28487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28487: -- Assignee: Marcelo Vanzin > K8S pod allocator behaves poorly with dynamic allocation >

[jira] [Created] (SPARK-28722) Change sequential label sorting in StringIndexer fit to parallel

Liang-Chi Hsieh created SPARK-28722: --- Summary: Change sequential label sorting in StringIndexer fit to parallel Key: SPARK-28722 URL: https://issues.apache.org/jira/browse/SPARK-28722 Project: Spark

[jira] [Commented] (SPARK-19653) `Vector` Type Should Be A First-Class Citizen In Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-19653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906751#comment-16906751 ] Tanmay Binaykiya commented on SPARK-19653: -- What is the status of this?  > `Ve

[jira] [Assigned] (SPARK-27768) Infinity, -Infinity, NaN should be recognized in a case insensitive manner

[ https://issues.apache.org/jira/browse/SPARK-27768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-27768: - Assignee: Dilip Biswal > Infinity, -Infinity, NaN should be recognized in a case insens

[jira] [Resolved] (SPARK-27768) Infinity, -Infinity, NaN should be recognized in a case insensitive manner

[ https://issues.apache.org/jira/browse/SPARK-27768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27768. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25331 [https://

[jira] [Created] (SPARK-28721) Failing to stop SparkSession in K8S cluster mode PySpark leaks Driver and Executors

Patrick Clay created SPARK-28721: Summary: Failing to stop SparkSession in K8S cluster mode PySpark leaks Driver and Executors Key: SPARK-28721 URL: https://issues.apache.org/jira/browse/SPARK-28721 P

[jira] [Updated] (SPARK-28712) spark structured stream with kafka don't really delete temp files in spark standalone cluster

[ https://issues.apache.org/jira/browse/SPARK-28712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 凭落 updated SPARK-28712: --- Environment: redhat 7 jdk 1.8 scala 2.11.12 spark standalone cluster 2.4.3 kafka 0.10.2.1   was: redhat 7 spa

[jira] [Updated] (SPARK-28713) Bump checkstyle from 8.14 to 8.23

[ https://issues.apache.org/jira/browse/SPARK-28713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28713: -- Fix Version/s: 2.4.4 > Bump checkstyle from 8.14 to 8.23 > - >

[jira] [Resolved] (SPARK-28720) Update AppVeyor R version to 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-28720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-28720. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25441 [https://github.com/a

[jira] [Resolved] (SPARK-28719) Enable Github Actions for building master

[ https://issues.apache.org/jira/browse/SPARK-28719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-28719. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25440 [https://github.com/a

[jira] [Resolved] (SPARK-28700) make_timestamp loses seconds fractions

[ https://issues.apache.org/jira/browse/SPARK-28700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28700. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25421 [https://

[jira] [Assigned] (SPARK-28700) make_timestamp loses seconds fractions

[ https://issues.apache.org/jira/browse/SPARK-28700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28700: - Assignee: Maxim Gekk > make_timestamp loses seconds fractions > ---

[jira] [Resolved] (SPARK-28718) Support field synonyms at `extract`

[ https://issues.apache.org/jira/browse/SPARK-28718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28718. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25438 [https://

[jira] [Assigned] (SPARK-28718) Support field synonyms at `extract`

[ https://issues.apache.org/jira/browse/SPARK-28718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28718: - Assignee: Maxim Gekk > Support field synonyms at `extract` > --

[jira] [Updated] (SPARK-28720) Update AppVeyor R version to 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-28720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28720: -- Issue Type: Improvement (was: Task) > Update AppVeyor R version to 3.6.1 > --

[jira] [Updated] (SPARK-28720) Update AppVeyor R version to 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-28720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28720: -- Component/s: (was: R) SparkR > Update AppVeyor R version to 3.6.1 > -

[jira] [Updated] (SPARK-28720) Update AppVeyor R version to 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-28720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28720: -- Issue Type: Test (was: Improvement) > Update AppVeyor R version to 3.6.1 > --

[jira] [Updated] (SPARK-28720) Update AppVeyor R version to 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-28720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28720: -- Issue Type: Task (was: Test) > Update AppVeyor R version to 3.6.1 > -

[jira] [Created] (SPARK-28720) Update AppVeyor R version to 3.6.1

Dongjoon Hyun created SPARK-28720: - Summary: Update AppVeyor R version to 3.6.1 Key: SPARK-28720 URL: https://issues.apache.org/jira/browse/SPARK-28720 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-28701) add java11 support for spark pull request builds

[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906660#comment-16906660 ] Dongjoon Hyun edited comment on SPARK-28701 at 8/13/19 10:08 PM: -

[jira] [Commented] (SPARK-28701) add java11 support for spark pull request builds

[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906660#comment-16906660 ] Dongjoon Hyun commented on SPARK-28701: --- BTW, [~shaneknapp]. Jenkins script seems

[jira] [Commented] (SPARK-28701) add java11 support for spark pull request builds

[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906654#comment-16906654 ] Dongjoon Hyun commented on SPARK-28701: --- Hi, [~shaneknapp]. For JDK11, during last

[jira] [Commented] (SPARK-27318) Join operation on bucketing table fails with base adaptive enabled

[ https://issues.apache.org/jira/browse/SPARK-27318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906648#comment-16906648 ] Jenny Liu commented on SPARK-27318: --- Is there an update about this issue?  What does

[jira] [Created] (SPARK-28719) Enable Github Actions for building master

DB Tsai created SPARK-28719: --- Summary: Enable Github Actions for building master Key: SPARK-28719 URL: https://issues.apache.org/jira/browse/SPARK-28719 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28707. --- Resolution: Not A Problem > Spark SQL select query result size issue > -

[jira] [Commented] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906624#comment-16906624 ] Dongjoon Hyun commented on SPARK-28707: --- I don't think this is a bug `maxResultSiz

[jira] [Commented] (SPARK-28701) add java11 support for spark pull request builds

[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906618#comment-16906618 ] shane knapp commented on SPARK-28701: - excellent. this is useful... thanks! > add

[jira] [Commented] (SPARK-28701) add java11 support for spark pull request builds

[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906613#comment-16906613 ] Sean Owen commented on SPARK-28701: --- I'm pretty sure the consensus is: support Java 8

[jira] [Commented] (SPARK-28701) add java11 support for spark pull request builds

[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906609#comment-16906609 ] shane knapp commented on SPARK-28701: - [~srowen] [~hyukjin.kwon] [~dongjoon] what i

[jira] [Created] (SPARK-28718) Support field synonyms at `extract`

Maxim Gekk created SPARK-28718: -- Summary: Support field synonyms at `extract` Key: SPARK-28718 URL: https://issues.apache.org/jira/browse/SPARK-28718 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-28708) IsolatedClientLoader will not load hive classes from application jars

[ https://issues.apache.org/jira/browse/SPARK-28708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28708. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25429 [https://

[jira] [Updated] (SPARK-28717) Update SQL ALTER TABLE RENAME to use TableCatalog#renameTable operation

[ https://issues.apache.org/jira/browse/SPARK-28717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edgar Rodriguez updated SPARK-28717: Summary: Update SQL ALTER TABLE RENAME to use TableCatalog#renameTable operation (was: U

[jira] [Assigned] (SPARK-28708) IsolatedClientLoader will not load hive classes from application jars

[ https://issues.apache.org/jira/browse/SPARK-28708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28708: - Assignee: Yuming Wang > IsolatedClientLoader will not load hive classes from applicatio

[jira] [Created] (SPARK-28717) Update SQL TABLE RENAME to use TableCatalog#renameTable operation

Edgar Rodriguez created SPARK-28717: --- Summary: Update SQL TABLE RENAME to use TableCatalog#renameTable operation Key: SPARK-28717 URL: https://issues.apache.org/jira/browse/SPARK-28717 Project: Spa

[jira] [Updated] (SPARK-28717) Update SQL ALTER TABLE RENAME to use TableCatalog API

[ https://issues.apache.org/jira/browse/SPARK-28717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edgar Rodriguez updated SPARK-28717: Summary: Update SQL ALTER TABLE RENAME to use TableCatalog API (was: Update SQL ALTER TA

[jira] [Commented] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906486#comment-16906486 ] Brian Zhang commented on SPARK-28681: - Thanks [~Udbhav Agrawal], I see where the dif

[jira] [Resolved] (SPARK-28713) Bump checkstyle from 8.14 to 8.23

[ https://issues.apache.org/jira/browse/SPARK-28713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28713. --- Resolution: Fixed Fix Version/s: 3.0.0 This is resolved via https://github.com/apache

[jira] [Commented] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906425#comment-16906425 ] Udbhav Agrawal commented on SPARK-28681: #Detailed Table Information

[jira] [Commented] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906417#comment-16906417 ] Brian Zhang commented on SPARK-28681: - Hi [~Udbhav Agrawal], Double checking, is yo

[jira] [Updated] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal updated SPARK-28681: --- Attachment: Screenshot from 2019-08-13 22-01-04.png > Spark SQL unable to read Hive ORC tabl

[jira] [Commented] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906384#comment-16906384 ] Udbhav Agrawal commented on SPARK-28681: !Screenshot from 2019-08-13 22-01-04.pn

[jira] [Comment Edited] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906381#comment-16906381 ] Udbhav Agrawal edited comment on SPARK-28681 at 8/13/19 4:40 PM: -

[jira] [Comment Edited] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906381#comment-16906381 ] Udbhav Agrawal edited comment on SPARK-28681 at 8/13/19 4:37 PM: -

[jira] [Commented] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906381#comment-16906381 ] Udbhav Agrawal commented on SPARK-28681: !Screenshot from 2019-08-13 22-01-04.pn

[jira] [Updated] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal updated SPARK-28681: --- Attachment: Screenshot from 2019-08-13 22-01-04.png > Spark SQL unable to read Hive ORC tabl

[jira] [Updated] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal updated SPARK-28681: --- Attachment: (was: Screenshot from 2019-08-13 22-01-04.png) > Spark SQL unable to read Hi

[jira] [Updated] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal updated SPARK-28681: --- Attachment: Screenshot from 2019-08-13 22-01-04.png > Spark SQL unable to read Hive ORC tabl

[jira] [Updated] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal updated SPARK-28681: --- Attachment: (was: Screenshot from 2019-08-13 22-01-04.png) > Spark SQL unable to read Hi

[jira] [Assigned] (SPARK-28714) Add test for spark-sql support hive.aux.jars.path

[ https://issues.apache.org/jira/browse/SPARK-28714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28714: - Assignee: Yuming Wang > Add test for spark-sql support hive.aux.jars.path > ---

[jira] [Resolved] (SPARK-28714) Add test for spark-sql support hive.aux.jars.path

[ https://issues.apache.org/jira/browse/SPARK-28714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28714. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25435 [https://

[jira] [Commented] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906367#comment-16906367 ] Hyukjin Kwon commented on SPARK-28681: -- Actually I resolved given [~Udbhav Agrawal]

[jira] [Updated] (SPARK-28713) Bump checkstyle from 8.14 to 8.23

[ https://issues.apache.org/jira/browse/SPARK-28713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28713: -- Summary: Bump checkstyle from 8.14 to 8.23 (was: Bump checkstyle from 8.14 to 8.18) > Bump c

[jira] [Assigned] (SPARK-28713) Bump checkstyle from 8.14 to 8.23

[ https://issues.apache.org/jira/browse/SPARK-28713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28713: - Assignee: Fokko Driesprong > Bump checkstyle from 8.14 to 8.23 > --

[jira] [Commented] (SPARK-28681) Spark SQL unable to read Hive ORC table with numeric column name

[ https://issues.apache.org/jira/browse/SPARK-28681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906362#comment-16906362 ] Brian Zhang commented on SPARK-28681: - Hi [~Udbhav Agrawal], I'm a bit confused her

[jira] [Resolved] (SPARK-28422) GROUPED_AGG pandas_udf doesn't with spark.sql() without group by clause

[ https://issues.apache.org/jira/browse/SPARK-28422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28422. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25352 [https://gi

[jira] [Assigned] (SPARK-28422) GROUPED_AGG pandas_udf doesn't with spark.sql() without group by clause

[ https://issues.apache.org/jira/browse/SPARK-28422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28422: Assignee: Liang-Chi Hsieh > GROUPED_AGG pandas_udf doesn't with spark.sql() without group

[jira] [Updated] (SPARK-28716) Add id to Exchange and Subquery's stringArgs method for easier identifying their reuses in query plans

[ https://issues.apache.org/jira/browse/SPARK-28716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-28716: - Description: Add id to Exchange and Subquery's stringArgs method for easier identifying their r

[jira] [Updated] (SPARK-28716) Add id to Exchange and Subquery's stringArgs method for easier identifying their reuses in query plans

[ https://issues.apache.org/jira/browse/SPARK-28716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-28716: - Description: Add id to Exchange and Subquery's stringArgs method for easier identifying their r

[jira] [Updated] (SPARK-28716) Add id to Exchange and Subquery's stringArgs method for easier identifying their reuses in query plans

[ https://issues.apache.org/jira/browse/SPARK-28716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-28716: - Description: Add id to Exchange and Subquery's stringArgs method for easier identifying their r

[jira] [Created] (SPARK-28716) Add id to Exchange and Subquery's stringArgs method for easier identifying their reuses in query plans

Ali Afroozeh created SPARK-28716: Summary: Add id to Exchange and Subquery's stringArgs method for easier identifying their reuses in query plans Key: SPARK-28716 URL: https://issues.apache.org/jira/browse/SPARK-2

[jira] [Updated] (SPARK-28714) Add test for spark-sql support hive.aux.jars.path

[ https://issues.apache.org/jira/browse/SPARK-28714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28714: Description: {{Utilities.addToClassPath}} was removed since HIVE-21584 and we will backport that c

[jira] [Updated] (SPARK-28714) Add test for spark-sql support hive.aux.jars.path

[ https://issues.apache.org/jira/browse/SPARK-28714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28714: Description: Utilities.addToClassPath was removed since HIVE-21584 and we will back it to our Spar

[jira] [Updated] (SPARK-28715) Introduce collectInPlanAndSubqueries and subqueriesAll in QueryPlan

[ https://issues.apache.org/jira/browse/SPARK-28715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ali Afroozeh updated SPARK-28715: - Summary: Introduce collectInPlanAndSubqueries and subqueriesAll in QueryPlan (was: Introduce `c

[jira] [Created] (SPARK-28715) Introduce `collectInPlanAndSubqueries` and `subqueriesAll` in `QueryPlan`

Ali Afroozeh created SPARK-28715: Summary: Introduce `collectInPlanAndSubqueries` and `subqueriesAll` in `QueryPlan` Key: SPARK-28715 URL: https://issues.apache.org/jira/browse/SPARK-28715 Project: Sp

[jira] [Created] (SPARK-28714) Add test for spark-sql support hive.aux.jars.path

Yuming Wang created SPARK-28714: --- Summary: Add test for spark-sql support hive.aux.jars.path Key: SPARK-28714 URL: https://issues.apache.org/jira/browse/SPARK-28714 Project: Spark Issue Type: S

[jira] [Updated] (SPARK-28709) Memory leaks after stopping of StreamingContext

[ https://issues.apache.org/jira/browse/SPARK-28709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikita Gorbachevski updated SPARK-28709: Description: In my application spark streaming is restarted programmatically by st

[jira] [Created] (SPARK-28713) Bump checkstyle from 8.14 to 8.18

Fokko Driesprong created SPARK-28713: Summary: Bump checkstyle from 8.14 to 8.18 Key: SPARK-28713 URL: https://issues.apache.org/jira/browse/SPARK-28713 Project: Spark Issue Type: Task

[jira] [Comment Edited] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906265#comment-16906265 ] angerszhu edited comment on SPARK-28707 at 8/13/19 2:34 PM:

[jira] [Commented] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906265#comment-16906265 ] angerszhu commented on SPARK-28707: --- [~S71955] In case Limit , # it will take(n) of 

[jira] [Commented] (SPARK-23151) Provide a distribution of Spark with Hadoop 3.0

[ https://issues.apache.org/jira/browse/SPARK-23151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906218#comment-16906218 ] Thomas Graves commented on SPARK-23151: --- Hey so for the hadoop-3.2 profile, the de

[jira] [Created] (SPARK-28712) spark structured stream with kafka don't really delete temp files in spark standalone cluster

凭落 created SPARK-28712: -- Summary: spark structured stream with kafka don't really delete temp files in spark standalone cluster Key: SPARK-28712 URL: https://issues.apache.org/jira/browse/SPARK-28712 Project: Sp

[jira] [Commented] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906187#comment-16906187 ] Sujith Chacko commented on SPARK-28707: --- [~angerszhuuu]  In case of limit as you t

[jira] [Commented] (SPARK-28710) [UDF] create or replace permanent function does not clear the jar in class path

[ https://issues.apache.org/jira/browse/SPARK-28710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906180#comment-16906180 ] Sandeep Katta commented on SPARK-28710: --- cc [~dongjoon] [~hyukjin.kwon]  requires

[jira] [Resolved] (SPARK-28698) Allow user-specified output schema in function `to_avro`

[ https://issues.apache.org/jira/browse/SPARK-28698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28698. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25419 [https://gith

[jira] [Assigned] (SPARK-28698) Allow user-specified output schema in function `to_avro`

[ https://issues.apache.org/jira/browse/SPARK-28698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28698: --- Assignee: Gengliang Wang > Allow user-specified output schema in function `to_avro` > -

[jira] [Resolved] (SPARK-28706) Allow upcast from null type to any types

[ https://issues.apache.org/jira/browse/SPARK-28706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28706. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25425 [https://gith

[jira] [Created] (SPARK-28711) [SQL] ThriftServer is not starting after upgrading the spark to 3.0

Sandeep Katta created SPARK-28711: - Summary: [SQL] ThriftServer is not starting after upgrading the spark to 3.0 Key: SPARK-28711 URL: https://issues.apache.org/jira/browse/SPARK-28711 Project: Spark

[jira] [Commented] (SPARK-28710) [UDF] create or replace permanent function does not clear the jar in class path

[ https://issues.apache.org/jira/browse/SPARK-28710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906085#comment-16906085 ] Sandeep Katta commented on SPARK-28710: --- [~abhishek.akg] thanks for raising this i

[jira] [Created] (SPARK-28710) [UDF] create or replace permanent function does not clear the jar in class path

ABHISHEK KUMAR GUPTA created SPARK-28710: Summary: [UDF] create or replace permanent function does not clear the jar in class path Key: SPARK-28710 URL: https://issues.apache.org/jira/browse/SPARK-28710

[jira] [Commented] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906080#comment-16906080 ] Sujith Chacko commented on SPARK-28707: --- In both case the result size shall be 100

[jira] [Commented] (SPARK-28707) Spark SQL select query result size issue

[ https://issues.apache.org/jira/browse/SPARK-28707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906076#comment-16906076 ] angerszhu commented on SPARK-28707: --- When we call a limit, it will change to a SingleP

[jira] [Updated] (SPARK-28709) Memory leaks after stopping of StreamingContext

[ https://issues.apache.org/jira/browse/SPARK-28709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikita Gorbachevski updated SPARK-28709: Description: In my application spark streaming is restarted programmatically by st

[jira] [Created] (SPARK-28709) Memory leaks after stopping of StreamingContext

Nikita Gorbachevski created SPARK-28709: --- Summary: Memory leaks after stopping of StreamingContext Key: SPARK-28709 URL: https://issues.apache.org/jira/browse/SPARK-28709 Project: Spark

  1   2   >