[jira] [Created] (SPARK-33988) Add an option to enable CBO in TPCDSQueryBenchmark

Takeshi Yamamuro created SPARK-33988: Summary: Add an option to enable CBO in TPCDSQueryBenchmark Key: SPARK-33988 URL: https://issues.apache.org/jira/browse/SPARK-33988 Project: Spark Is

[jira] [Created] (SPARK-33945) Handles a random seed consisting of an expr tree

Takeshi Yamamuro created SPARK-33945: Summary: Handles a random seed consisting of an expr tree Key: SPARK-33945 URL: https://issues.apache.org/jira/browse/SPARK-33945 Project: Spark Issu

[jira] [Resolved] (SPARK-33084) Add jar support ivy path

[ https://issues.apache.org/jira/browse/SPARK-33084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33084. -- Fix Version/s: 3.2.0 Assignee: angerszhu Resolution: Fixed Resolve by

[jira] [Updated] (SPARK-33877) Documents a column list of INSERT in the SQL documents

[ https://issues.apache.org/jira/browse/SPARK-33877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33877: - Fix Version/s: (was: 3.1.0) > Documents a column list of INSERT in the SQL documents

[jira] [Created] (SPARK-33877) Documents a column list of INSERT in the SQL documents

Takeshi Yamamuro created SPARK-33877: Summary: Documents a column list of INSERT in the SQL documents Key: SPARK-33877 URL: https://issues.apache.org/jira/browse/SPARK-33877 Project: Spark

[jira] [Resolved] (SPARK-32106) Implement script transform in sql/core

[ https://issues.apache.org/jira/browse/SPARK-32106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32106. -- Fix Version/s: 3.2.0 Assignee: angerszhu Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-33124) Adds a group tag in all the expressions for built-in functions

[ https://issues.apache.org/jira/browse/SPARK-33124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33124: - Affects Version/s: (was: 3.1.0) 3.2.0 > Adds a group tag in a

[jira] [Commented] (SPARK-33828) SQL Adaptive Query Execution QA

[ https://issues.apache.org/jira/browse/SPARK-33828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17251403#comment-17251403 ] Takeshi Yamamuro commented on SPARK-33828: -- Thanks for letting me know, Dongjoo

[jira] [Updated] (SPARK-33823) Use the `CastSupport.cast` method in HashJoin

[ https://issues.apache.org/jira/browse/SPARK-33823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33823: - Issue Type: Bug (was: Improvement) > Use the `CastSupport.cast` method in HashJoin > --

[jira] [Commented] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17250842#comment-17250842 ] Takeshi Yamamuro commented on SPARK-33822: -- Ah, I made a PR a minute ago in htt

[jira] [Created] (SPARK-33823) Use the `CastSupport.cast` method in HashJoin

Takeshi Yamamuro created SPARK-33823: Summary: Use the `CastSupport.cast` method in HashJoin Key: SPARK-33823 URL: https://issues.apache.org/jira/browse/SPARK-33823 Project: Spark Issue T

[jira] [Resolved] (SPARK-33677) LikeSimplification should be skipped if pattern contains any escapeChar

[ https://issues.apache.org/jira/browse/SPARK-33677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33677. -- Fix Version/s: 3.2.0 3.1.0 3.0.2 Resolutio

[jira] [Created] (SPARK-33690) Escape meta-characters in showString

Takeshi Yamamuro created SPARK-33690: Summary: Escape meta-characters in showString Key: SPARK-33690 URL: https://issues.apache.org/jira/browse/SPARK-33690 Project: Spark Issue Type: Impr

[jira] [Resolved] (SPARK-33503) Refactor SortOrder class to allow multiple childrens

[ https://issues.apache.org/jira/browse/SPARK-33503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33503. -- Fix Version/s: 3.1.0 Assignee: Prakhar Jain Resolution: Fixed Resolved

[jira] [Resolved] (SPARK-29638) Spark handles 'NaN' as 0 in sums

[ https://issues.apache.org/jira/browse/SPARK-29638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-29638. -- Resolution: Cannot Reproduce > Spark handles 'NaN' as 0 in sums >

[jira] [Commented] (SPARK-29638) Spark handles 'NaN' as 0 in sums

[ https://issues.apache.org/jira/browse/SPARK-29638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17240710#comment-17240710 ] Takeshi Yamamuro commented on SPARK-29638: -- 'NaN' is a special value for float/

[jira] [Resolved] (SPARK-28506) not handling usage of group function and window function at some conditions

[ https://issues.apache.org/jira/browse/SPARK-28506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-28506. -- Resolution: Cannot Reproduce > not handling usage of group function and window functio

[jira] [Commented] (SPARK-28506) not handling usage of group function and window function at some conditions

[ https://issues.apache.org/jira/browse/SPARK-28506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17240703#comment-17240703 ] Takeshi Yamamuro commented on SPARK-28506: -- I've checked both systems cannot ac

[jira] [Updated] (SPARK-33534) Allow specifying a minimum number of bytes in a split of a file

[ https://issues.apache.org/jira/browse/SPARK-33534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33534: - Component/s: (was: Input/Output) SQL > Allow specifying a minimum n

[jira] [Resolved] (SPARK-33506) t 130038ERROR ContextCleaner:91 - Error cleaning broadcast

[ https://issues.apache.org/jira/browse/SPARK-33506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33506. -- Resolution: Cannot Reproduce > t 130038ERROR ContextCleaner:91 - Error cleaning broadc

[jira] [Commented] (SPARK-33506) t 130038ERROR ContextCleaner:91 - Error cleaning broadcast

[ https://issues.apache.org/jira/browse/SPARK-33506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17236821#comment-17236821 ] Takeshi Yamamuro commented on SPARK-33506: -- I will close this now based on the

[jira] [Commented] (SPARK-33506) t 130038ERROR ContextCleaner:91 - Error cleaning broadcast

[ https://issues.apache.org/jira/browse/SPARK-33506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17236534#comment-17236534 ] Takeshi Yamamuro commented on SPARK-33506: -- I think the description is not enou

[jira] [Updated] (SPARK-28103) Cannot infer filters from union table with empty local relation table properly

[ https://issues.apache.org/jira/browse/SPARK-28103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-28103: - Affects Version/s: 3.1.0 3.0.2 2.4.8 > Can

[jira] [Updated] (SPARK-28103) Cannot infer filters from union table with empty local relation table properly

[ https://issues.apache.org/jira/browse/SPARK-28103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-28103: - Issue Type: Improvement (was: Bug) > Cannot infer filters from union table with empty l

[jira] [Commented] (SPARK-28103) Cannot infer filters from union table with empty local relation table properly

[ https://issues.apache.org/jira/browse/SPARK-28103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17235428#comment-17235428 ] Takeshi Yamamuro commented on SPARK-28103: -- It seem this is related to [https:/

[jira] [Resolved] (SPARK-33479) Make apiKey of docsearch configurable

[ https://issues.apache.org/jira/browse/SPARK-33479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33479. -- Fix Version/s: 3.1.0 Resolution: Fixed Resolved by https://github.com/apache/sp

[jira] [Resolved] (SPARK-33354) New explicit cast syntax rules in ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-33354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33354. -- Fix Version/s: 3.1.0 Resolution: Fixed Resolved by https://github.com/apache/sp

[jira] [Created] (SPARK-33475) Bump ANTLR runtime version to 4.8-1

Takeshi Yamamuro created SPARK-33475: Summary: Bump ANTLR runtime version to 4.8-1 Key: SPARK-33475 URL: https://issues.apache.org/jira/browse/SPARK-33475 Project: Spark Issue Type: Impro

[jira] [Commented] (SPARK-33395) Spark reading data in scientific notation

[ https://issues.apache.org/jira/browse/SPARK-33395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233276#comment-17233276 ] Takeshi Yamamuro commented on SPARK-33395: -- How about using a decimal type inst

[jira] [Updated] (SPARK-33395) Spark reading data in scientific notation

[ https://issues.apache.org/jira/browse/SPARK-33395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33395: - Issue Type: Improvement (was: Bug) > Spark reading data in scientific notation > --

[jira] [Commented] (SPARK-33395) Spark reading data in scientific notation

[ https://issues.apache.org/jira/browse/SPARK-33395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233267#comment-17233267 ] Takeshi Yamamuro commented on SPARK-33395: -- hm, but we cannot avoid the roundin

[jira] [Updated] (SPARK-33395) Spark reading data in scientific notation

[ https://issues.apache.org/jira/browse/SPARK-33395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33395: - Priority: Major (was: Critical) > Spark reading data in scientific notation > -

[jira] [Updated] (SPARK-33395) Spark reading data in scientific notation

[ https://issues.apache.org/jira/browse/SPARK-33395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33395: - Affects Version/s: 3.1.0 2.4.8 > Spark reading data in scientific

[jira] [Updated] (SPARK-33395) Spark reading data in scientific notation

[ https://issues.apache.org/jira/browse/SPARK-33395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33395: - Component/s: (was: Spark Core) SQL > Spark reading data in scientif

[jira] [Commented] (SPARK-33395) Spark reading data in scientific notation

[ https://issues.apache.org/jira/browse/SPARK-33395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233263#comment-17233263 ] Takeshi Yamamuro commented on SPARK-33395: -- The inferred type is double, so the

[jira] [Resolved] (SPARK-33379) The link address of ‘’this page’’ in docs/pyspark-migration-guide.md is incorrect

[ https://issues.apache.org/jira/browse/SPARK-33379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33379. -- Resolution: Not A Problem > The link address of ‘’this page’’ in docs/pyspark-migratio

[jira] [Resolved] (SPARK-33399) Normalize output partitioning and sortorder with respect to aliases to avoid unneeded exchange/sort nodes

[ https://issues.apache.org/jira/browse/SPARK-33399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33399. -- Fix Version/s: 3.1.0 Assignee: Prakhar Jain Resolution: Fixed Resolved

[jira] [Commented] (SPARK-33450) Engenharia de Dados Cognitivo.ai

[ https://issues.apache.org/jira/browse/SPARK-33450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17232024#comment-17232024 ] Takeshi Yamamuro commented on SPARK-33450: -- Please write the description in Eng

[jira] [Resolved] (SPARK-33450) Engenharia de Dados Cognitivo.ai

[ https://issues.apache.org/jira/browse/SPARK-33450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33450. -- Resolution: Invalid > Engenharia de Dados Cognitivo.ai > -

[jira] [Resolved] (SPARK-33433) Change Aggregate max rows to 1 if grouping is empty

[ https://issues.apache.org/jira/browse/SPARK-33433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33433. -- Fix Version/s: 3.1.0 Assignee: ulysses you Resolution: Fixed Resolved

[jira] [Resolved] (SPARK-33417) Correct the behaviour of query filters in TPCDSQueryBenchmark

[ https://issues.apache.org/jira/browse/SPARK-33417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33417. -- Fix Version/s: 3.1.0 3.0.2 2.4.8 Assigne

[jira] [Updated] (SPARK-33417) Correct the behaviour of query filters in TPCDSQueryBenchmark

[ https://issues.apache.org/jira/browse/SPARK-33417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33417: - Description: This PR intends to fix the behaviour of query filters in TPCDSQueryBenchmar

[jira] [Created] (SPARK-33417) Correct the behaviour of query filters in TPCDSQueryBenchmark

Takeshi Yamamuro created SPARK-33417: Summary: Correct the behaviour of query filters in TPCDSQueryBenchmark Key: SPARK-33417 URL: https://issues.apache.org/jira/browse/SPARK-33417 Project: Spark

[jira] [Resolved] (SPARK-33404) "date_trunc" expression returns incorrect results

[ https://issues.apache.org/jira/browse/SPARK-33404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33404. -- Fix Version/s: 3.1.0 Assignee: Utkarsh Agarwal Resolution: Fixed Resol

[jira] [Updated] (SPARK-33404) "date_trunc" expression returns incorrect results

[ https://issues.apache.org/jira/browse/SPARK-33404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33404: - Affects Version/s: 3.1.0 > "date_trunc" expression returns incorrect results > -

[jira] [Commented] (SPARK-12567) Add aes_encrypt and aes_decrypt UDFs

[ https://issues.apache.org/jira/browse/SPARK-12567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229023#comment-17229023 ] Takeshi Yamamuro commented on SPARK-12567: -- Reopened. > Add aes_encrypt and ae

[jira] [Updated] (SPARK-12567) Add aes_encrypt and aes_decrypt UDFs

[ https://issues.apache.org/jira/browse/SPARK-12567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-12567: - Labels: (was: bulk-closed) > Add aes_encrypt and aes_decrypt UDFs > --

[jira] [Updated] (SPARK-12567) Add aes_encrypt and aes_decrypt UDFs

[ https://issues.apache.org/jira/browse/SPARK-12567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-12567: - Affects Version/s: 3.1.0 > Add aes_encrypt and aes_decrypt UDFs > --

[jira] [Reopened] (SPARK-12567) Add aes_encrypt and aes_decrypt UDFs

[ https://issues.apache.org/jira/browse/SPARK-12567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro reopened SPARK-12567: -- Assignee: (was: Kai Jiang) > Add aes_encrypt and aes_decrypt UDFs >

[jira] [Commented] (SPARK-33400) Reduce unneeded sorts between two SortMergeJoins

[ https://issues.apache.org/jira/browse/SPARK-33400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229016#comment-17229016 ] Takeshi Yamamuro commented on SPARK-33400: -- Is this different from SPARK-33399 

[jira] [Commented] (SPARK-33401) Vector type column is not possible to create using spark SQL

[ https://issues.apache.org/jira/browse/SPARK-33401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229015#comment-17229015 ] Takeshi Yamamuro commented on SPARK-33401: -- I think this is not a bug but an ex

[jira] [Updated] (SPARK-33187) Add a check on the number of returned partitions in the HiveShim#getPartitionsByFilter method

[ https://issues.apache.org/jira/browse/SPARK-33187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33187: - Affects Version/s: (was: 3.0.1) 3.1.0 3

[jira] [Resolved] (SPARK-33397) mistakenly generate markdown to html for available-patterns-for-shs-custom-executor-log-ur

[ https://issues.apache.org/jira/browse/SPARK-33397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33397. -- Fix Version/s: 3.1.0 3.0.2 Assignee: Kent Yao Resolu

[jira] [Resolved] (SPARK-33272) prune the attributes mapping in QueryPlan.transformUpWithNewOutput

[ https://issues.apache.org/jira/browse/SPARK-33272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33272. -- Fix Version/s: 3.1.0 Resolution: Fixed Resolved by https://github.com/apache/sp

[jira] [Created] (SPARK-33268) Fix bugs for casting data from/to PythonUserDefinedType

Takeshi Yamamuro created SPARK-33268: Summary: Fix bugs for casting data from/to PythonUserDefinedType Key: SPARK-33268 URL: https://issues.apache.org/jira/browse/SPARK-33268 Project: Spark

[jira] [Resolved] (SPARK-33264) Add a dedicated page for SQL-on-file in SQL documents

[ https://issues.apache.org/jira/browse/SPARK-33264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33264. -- Fix Version/s: 3.1.0 3.0.2 Assignee: Takeshi Yamamuro

[jira] [Created] (SPARK-33264) Add a dedicated page for SQL-on-file in SQL documents

Takeshi Yamamuro created SPARK-33264: Summary: Add a dedicated page for SQL-on-file in SQL documents Key: SPARK-33264 URL: https://issues.apache.org/jira/browse/SPARK-33264 Project: Spark

[jira] [Updated] (SPARK-33228) Don't uncache data when replacing an existing view having the same plan

[ https://issues.apache.org/jira/browse/SPARK-33228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33228: - Fix Version/s: 2.4.8 > Don't uncache data when replacing an existing view having the sam

[jira] [Updated] (SPARK-32090) UserDefinedType.equal() does not have symmetry

[ https://issues.apache.org/jira/browse/SPARK-32090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32090: - Fix Version/s: 3.0.2 2.4.8 > UserDefinedType.equal() does not have sy

[jira] [Resolved] (SPARK-33246) Spark SQL null semantics documentation is incorrect

[ https://issues.apache.org/jira/browse/SPARK-33246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33246. -- Fix Version/s: 3.1.0 3.0.2 Assignee: Stuart White Re

[jira] [Updated] (SPARK-33246) Spark SQL null semantics documentation is incorrect

[ https://issues.apache.org/jira/browse/SPARK-33246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33246: - Affects Version/s: (was: 3.0.1) 3.1.0 3

[jira] [Updated] (SPARK-33246) Spark SQL null semantics documentation is incorrect

[ https://issues.apache.org/jira/browse/SPARK-33246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33246: - Component/s: SQL > Spark SQL null semantics documentation is incorrect > ---

[jira] [Updated] (SPARK-33183) Bug in optimizer rule EliminateSorts

[ https://issues.apache.org/jira/browse/SPARK-33183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33183: - Issue Type: Bug (was: Improvement) > Bug in optimizer rule EliminateSorts > ---

[jira] [Updated] (SPARK-33183) Bug in optimizer rule EliminateSorts

[ https://issues.apache.org/jira/browse/SPARK-33183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33183: - Issue Type: Improvement (was: Bug) > Bug in optimizer rule EliminateSorts > ---

[jira] [Resolved] (SPARK-33225) Extract AliasHelper trait

[ https://issues.apache.org/jira/browse/SPARK-33225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33225. -- Fix Version/s: 3.1.0 Assignee: Tanel Kiis Resolution: Fixed Resolved b

[jira] [Updated] (SPARK-33183) Bug in optimizer rule EliminateSorts

[ https://issues.apache.org/jira/browse/SPARK-33183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33183: - Affects Version/s: (was: 3.0.1) (was: 3.0.0)

[jira] [Commented] (SPARK-33233) CUBE/ROLLUP can't support UnresolvedOrdinal

[ https://issues.apache.org/jira/browse/SPARK-33233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17220648#comment-17220648 ] Takeshi Yamamuro commented on SPARK-33233: -- Please fill the description. > CUB

[jira] [Updated] (SPARK-33233) CUBE/ROLLUP can't support UnresolvedOrdinal

[ https://issues.apache.org/jira/browse/SPARK-33233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33233: - Issue Type: Improvement (was: Bug) > CUBE/ROLLUP can't support UnresolvedOrdinal >

[jira] [Resolved] (SPARK-33075) Only disable auto bucketed scan for cached query

[ https://issues.apache.org/jira/browse/SPARK-33075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33075. -- Fix Version/s: 3.1.0 Assignee: Cheng Su Resolution: Fixed Resolved by 

[jira] [Resolved] (SPARK-33197) Changes to spark.sql.analyzer.maxIterations do not take effect at runtime

[ https://issues.apache.org/jira/browse/SPARK-33197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33197. -- Fix Version/s: 3.1.0 3.0.2 Assignee: Yuning Zhang Re

[jira] [Updated] (SPARK-33229) UnsupportedOperationException when group by with cube

[ https://issues.apache.org/jira/browse/SPARK-33229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33229: - Issue Type: Improvement (was: Bug) > UnsupportedOperationException when group by with c

[jira] [Updated] (SPARK-33229) UnsupportedOperationException when group by with cube

[ https://issues.apache.org/jira/browse/SPARK-33229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33229: - Affects Version/s: (was: 3.0.1) (was: 3.0.0) > Unsupporte

[jira] [Created] (SPARK-33228) Don't uncache data when replacing an existing view having the same plan

Takeshi Yamamuro created SPARK-33228: Summary: Don't uncache data when replacing an existing view having the same plan Key: SPARK-33228 URL: https://issues.apache.org/jira/browse/SPARK-33228 Proje

[jira] [Resolved] (SPARK-26533) Support query auto cancel on thriftserver

[ https://issues.apache.org/jira/browse/SPARK-26533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-26533. -- Fix Version/s: 3.1.0 Assignee: Xuedong Luan Resolution: Fixed Resolved

[jira] [Updated] (SPARK-33197) Changes to spark.sql.analyzer.maxIterations do not take effect at runtime

[ https://issues.apache.org/jira/browse/SPARK-33197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33197: - Affects Version/s: (was: 3.0.0) 3.0.2 > Changes to spark.sql.

[jira] [Created] (SPARK-33205) Bump snappy-java version to 1.1.8

Takeshi Yamamuro created SPARK-33205: Summary: Bump snappy-java version to 1.1.8 Key: SPARK-33205 URL: https://issues.apache.org/jira/browse/SPARK-33205 Project: Spark Issue Type: Improve

[jira] [Resolved] (SPARK-32229) Application entry parsing fails because DriverWrapper registered instead of the normal driver

[ https://issues.apache.org/jira/browse/SPARK-32229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32229. -- Fix Version/s: 3.1.0 Assignee: Gabor Somogyi Resolution: Fixed Resolve

[jira] [Created] (SPARK-33165) Remove dependencies(scalatest,scalactic) from Benchmark

Takeshi Yamamuro created SPARK-33165: Summary: Remove dependencies(scalatest,scalactic) from Benchmark Key: SPARK-33165 URL: https://issues.apache.org/jira/browse/SPARK-33165 Project: Spark

[jira] [Updated] (SPARK-25547) Pluggable jdbc connection factory

[ https://issues.apache.org/jira/browse/SPARK-25547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25547: - Component/s: (was: Spark Core) SQL > Pluggable jdbc connection fact

[jira] [Updated] (SPARK-25547) Pluggable jdbc connection factory

[ https://issues.apache.org/jira/browse/SPARK-25547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25547: - Target Version/s: (was: 3.0.0) > Pluggable jdbc connection factory > -

[jira] [Resolved] (SPARK-25547) Pluggable jdbc connection factory

[ https://issues.apache.org/jira/browse/SPARK-25547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-25547. -- Resolution: Duplicate > Pluggable jdbc connection factory > --

[jira] [Resolved] (SPARK-32295) Add not null and size > 0 filters before inner explode to benefit from predicate pushdown

[ https://issues.apache.org/jira/browse/SPARK-32295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32295. -- Fix Version/s: 3.1.0 Assignee: Tanel Kiis Resolution: Fixed Resolved b

[jira] [Commented] (SPARK-30893) Expressions should not change its data type/nullability after it's created

[ https://issues.apache.org/jira/browse/SPARK-30893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212731#comment-17212731 ] Takeshi Yamamuro commented on SPARK-30893: -- You find any data corruption in bra

[jira] [Created] (SPARK-33124) Adds a group tag in all the expressions for built-in functions

Takeshi Yamamuro created SPARK-33124: Summary: Adds a group tag in all the expressions for built-in functions Key: SPARK-33124 URL: https://issues.apache.org/jira/browse/SPARK-33124 Project: Spark

[jira] [Resolved] (SPARK-32989) Performance regression when selecting from str_to_map

[ https://issues.apache.org/jira/browse/SPARK-32989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32989. -- Fix Version/s: 3.1.0 Assignee: L. C. Hsieh Resolution: Fixed > Perform

[jira] [Resolved] (SPARK-33092) Support subexpression elimination in ProjectExec

[ https://issues.apache.org/jira/browse/SPARK-33092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33092. -- Fix Version/s: 3.1.0 Resolution: Fixed Resolved by https://github.com/apache/sp

[jira] [Commented] (SPARK-24930) Exception information is not accurate when using `LOAD DATA LOCAL INPATH`

[ https://issues.apache.org/jira/browse/SPARK-24930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212205#comment-17212205 ] Takeshi Yamamuro commented on SPARK-24930: -- hm, I see. Could you check the reso

[jira] [Commented] (SPARK-24930) Exception information is not accurate when using `LOAD DATA LOCAL INPATH`

[ https://issues.apache.org/jira/browse/SPARK-24930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212196#comment-17212196 ] Takeshi Yamamuro commented on SPARK-24930: -- Do you know which pr resolves this?

[jira] [Commented] (SPARK-33013) The constrains may grow exponentially in sql optimizer 'InferFiltersFromConstraints', which leads to driver oom

[ https://issues.apache.org/jira/browse/SPARK-33013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212131#comment-17212131 ] Takeshi Yamamuro commented on SPARK-33013: -- Yea, that's a known issue, so I wil

[jira] [Resolved] (SPARK-33013) The constrains may grow exponentially in sql optimizer 'InferFiltersFromConstraints', which leads to driver oom

[ https://issues.apache.org/jira/browse/SPARK-33013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33013. -- Resolution: Not A Problem > The constrains may grow exponentially in sql optimizer >

[jira] [Resolved] (SPARK-33116) Spark SQL window function with order by cause result incorrect

[ https://issues.apache.org/jira/browse/SPARK-33116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33116. -- Resolution: Invalid > Spark SQL window function with order by cause result incorrect >

[jira] [Commented] (SPARK-33116) Spark SQL window function with order by cause result incorrect

[ https://issues.apache.org/jira/browse/SPARK-33116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212130#comment-17212130 ] Takeshi Yamamuro commented on SPARK-33116: -- In SQL, they are different, I think

[jira] [Commented] (SPARK-33110) array_contains doesn't pick element in the array but just at the end

[ https://issues.apache.org/jira/browse/SPARK-33110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17211803#comment-17211803 ] Takeshi Yamamuro commented on SPARK-33110: -- Could you please simplify it? Other

[jira] [Commented] (SPARK-33110) array_contains doesn't pick element in the array but just at the end

[ https://issues.apache.org/jira/browse/SPARK-33110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17211706#comment-17211706 ] Takeshi Yamamuro commented on SPARK-33110: -- Could you put complete code to repr

[jira] [Updated] (SPARK-33110) array_contains doesn't pick element in the array but just at the end

[ https://issues.apache.org/jira/browse/SPARK-33110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33110: - Priority: Major (was: Blocker) > array_contains doesn't pick element in the array but j

[jira] [Updated] (SPARK-33110) array_contains doesn't pick element in the array but just at the end

[ https://issues.apache.org/jira/browse/SPARK-33110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33110: - Component/s: (was: ML) SQL > array_contains doesn't pick element in

[jira] [Resolved] (SPARK-32743) Add distinct info at UnresolvedFunction toString

[ https://issues.apache.org/jira/browse/SPARK-32743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32743. -- Fix Version/s: 3.1.0 Assignee: ulysses you Resolution: Fixed Resolved

[jira] [Resolved] (SPARK-33091) Avoid using map instead of foreach to avoid potential side effect at callers of OrcUtils.readCatalystSchema

[ https://issues.apache.org/jira/browse/SPARK-33091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33091. -- Fix Version/s: 3.02 3.1.0 Assignee: Hyukjin Kwon Res

[jira] [Resolved] (SPARK-31913) StackOverflowError in FileScanRDD

[ https://issues.apache.org/jira/browse/SPARK-31913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31913. -- Resolution: Cannot Reproduce > StackOverflowError in FileScanRDD > ---

[jira] [Commented] (SPARK-31913) StackOverflowError in FileScanRDD

[ https://issues.apache.org/jira/browse/SPARK-31913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209946#comment-17209946 ] Takeshi Yamamuro commented on SPARK-31913: -- Since this issue looks env-dependen

<    1   2   3   4   5   6   7   8   9   10   >