[jira] [Commented] (SPARK-39750) Enable spark.sql.cbo.enabled by default

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17565291#comment-17565291 ] Apache Spark commented on SPARK-39750: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-39750) Enable spark.sql.cbo.enabled by default

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39750: Assignee: (was: Apache Spark) > Enable spark.sql.cbo.enabled by default > ---

[jira] [Commented] (SPARK-39750) Enable spark.sql.cbo.enabled by default

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17565289#comment-17565289 ] Apache Spark commented on SPARK-39750: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-39750) Enable spark.sql.cbo.enabled by default

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39750: Assignee: Apache Spark > Enable spark.sql.cbo.enabled by default > --

[jira] [Created] (SPARK-39750) Enable spark.sql.cbo.enabled by default

2022-07-11 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39750: --- Summary: Enable spark.sql.cbo.enabled by default Key: SPARK-39750 URL: https://issues.apache.org/jira/browse/SPARK-39750 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-39647) Block push fails with java.lang.IllegalArgumentException: Active local dirs list has not been updated by any executor registration even when the NodeManager hasn't been

2022-07-11 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-39647. - Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue res

[jira] [Assigned] (SPARK-39647) Block push fails with java.lang.IllegalArgumentException: Active local dirs list has not been updated by any executor registration even when the NodeManager hasn't been

2022-07-11 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-39647: --- Assignee: Chandni Singh > Block push fails with java.lang.IllegalArgumentEx

[jira] [Commented] (SPARK-38910) Clean sparkStaging dir should before unregister()

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17565243#comment-17565243 ] Apache Spark commented on SPARK-38910: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-38910) Clean sparkStaging dir should before unregister()

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17565242#comment-17565242 ] Apache Spark commented on SPARK-38910: -- User 'AngersZh' has created a pull requ

[jira] [Resolved] (SPARK-39723) Implement functionExists/getFunc in SparkR for 3L namespace

2022-07-11 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-39723. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37135 [https://

[jira] [Assigned] (SPARK-39723) Implement functionExists/getFunc in SparkR for 3L namespace

2022-07-11 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-39723: - Assignee: Ruifeng Zheng > Implement functionExists/getFunc in SparkR for 3L namespace >

[jira] [Updated] (SPARK-39749) Always use plain string representation on casting Decimal to String

2022-07-11 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39749: --- Summary: Always use plain string representation on casting Decimal to String (was: Use plai

[jira] [Assigned] (SPARK-39748) Include the origin logical plan for LogicalRDD if it comes from DataFrame

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39748: Assignee: (was: Apache Spark) > Include the origin logical plan for LogicalRDD if it

[jira] [Assigned] (SPARK-39748) Include the origin logical plan for LogicalRDD if it comes from DataFrame

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39748: Assignee: Apache Spark > Include the origin logical plan for LogicalRDD if it comes from

[jira] [Commented] (SPARK-39748) Include the origin logical plan for LogicalRDD if it comes from DataFrame

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17565236#comment-17565236 ] Apache Spark commented on SPARK-39748: -- User 'HeartSaVioR' has created a pull reque

[jira] [Commented] (SPARK-39749) Use plain string representation on casting Decimal to String

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17565235#comment-17565235 ] Apache Spark commented on SPARK-39749: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-39749) Use plain string representation on casting Decimal to String

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39749: Assignee: Apache Spark (was: Gengliang Wang) > Use plain string representation on castin

[jira] [Commented] (SPARK-39749) Use plain string representation on casting Decimal to String

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17565234#comment-17565234 ] Apache Spark commented on SPARK-39749: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-39749) Use plain string representation on casting Decimal to String

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39749: Assignee: Gengliang Wang (was: Apache Spark) > Use plain string representation on castin

[jira] [Resolved] (SPARK-39711) Remove redundant trait: BeforeAndAfterAll & BeforeAndAfterEach & Logging

2022-07-11 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39711. Fix Version/s: 3.4.0 Assignee: BingKun Pan Resolution: Fixed > Remove redundant tr

[jira] [Created] (SPARK-39749) Use plain string representation on casting Decimal to String

2022-07-11 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-39749: -- Summary: Use plain string representation on casting Decimal to String Key: SPARK-39749 URL: https://issues.apache.org/jira/browse/SPARK-39749 Project: Spark

[jira] [Resolved] (SPARK-39737) PERCENTILE_CONT and PERCENTILE_DISC should support aggregate filter

2022-07-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39737. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37150 [https://gith

[jira] [Assigned] (SPARK-39737) PERCENTILE_CONT and PERCENTILE_DISC should support aggregate filter

2022-07-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39737: --- Assignee: jiaan.geng > PERCENTILE_CONT and PERCENTILE_DISC should support aggregate filter

[jira] [Created] (SPARK-39748) Include the origin logical plan for LogicalRDD if it comes from DataFrame

2022-07-11 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-39748: Summary: Include the origin logical plan for LogicalRDD if it comes from DataFrame Key: SPARK-39748 URL: https://issues.apache.org/jira/browse/SPARK-39748 Project: Sp

[jira] [Updated] (SPARK-39741) Support url encode/decode as built-in function

2022-07-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-39741: Fix Version/s: (was: 3.4.0) > Support url encode/decode as built-in function > ---

[jira] [Updated] (SPARK-39723) Implement functionExists/getFunc in SparkR for 3L namespace

2022-07-11 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-39723: -- Summary: Implement functionExists/getFunc in SparkR for 3L namespace (was: Implement function

[jira] [Assigned] (SPARK-39736) Enable base image build in SparkR job

2022-07-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39736: Assignee: Yikun Jiang > Enable base image build in SparkR job > -

[jira] [Resolved] (SPARK-39736) Enable base image build in SparkR job

2022-07-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39736. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37158 [https://gi

[jira] [Created] (SPARK-39747) pandas and pandas on Spark API parameter naming difference

2022-07-11 Thread Chenyang Zhang (Jira)
Chenyang Zhang created SPARK-39747: -- Summary: pandas and pandas on Spark API parameter naming difference Key: SPARK-39747 URL: https://issues.apache.org/jira/browse/SPARK-39747 Project: Spark

[jira] [Updated] (SPARK-39696) Uncaught exception in thread executor-heartbeater java.util.ConcurrentModificationException: mutation occurred during iteration

2022-07-11 Thread Stephen Mcmullan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Mcmullan updated SPARK-39696: - Fix Version/s: (was: 3.3.1) Target Version/s: (was: 3.3.0) > Uncaught excep

[jira] [Created] (SPARK-39746) Binary array operations can be faster if one side is a constant

2022-07-11 Thread David Vogelbacher (Jira)
David Vogelbacher created SPARK-39746: - Summary: Binary array operations can be faster if one side is a constant Key: SPARK-39746 URL: https://issues.apache.org/jira/browse/SPARK-39746 Project: Sp

[jira] [Created] (SPARK-39745) Accept a list that contains NumPy scalars in `createDataFrame`

2022-07-11 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-39745: Summary: Accept a list that contains NumPy scalars in `createDataFrame` Key: SPARK-39745 URL: https://issues.apache.org/jira/browse/SPARK-39745 Project: Spark

[jira] [Updated] (SPARK-39494) Support `createDataFrame` from a list of scalars when schema is not provided

2022-07-11 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-39494: - Description: Currently, DataFrame creation from a list of native Python scalars is unsupported

[jira] [Updated] (SPARK-39494) Support `createDataFrame` from a list of scalars when schema is not provided

2022-07-11 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-39494: - Description:   {{>>> spark.createDataFrame([1, 2]).collect()}} {{Traceback (most recent call la

[jira] [Updated] (SPARK-39494) Support `createDataFrame` from a list of scalars when schema is not provided

2022-07-11 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-39494: - Description: {{Currently, DataFrame creation from a list of native Python scalars is unsupporte

[jira] [Commented] (SPARK-38796) Implement the to_number and try_to_number SQL functions according to a new specification

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17565088#comment-17565088 ] Apache Spark commented on SPARK-38796: -- User 'cloud-fan' has created a pull request

[jira] [Updated] (SPARK-38999) Refactor DataSourceScanExec code to

2022-07-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38999: -- Target Version/s: (was: 3.3.0, 3.2.2, 3.4.0) > Refactor DataSourceScanExec code to > --

[jira] [Commented] (SPARK-38862) Basic Authentication or Token Based Authentication for The REST Submission Server

2022-07-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17565057#comment-17565057 ] Dongjoon Hyun commented on SPARK-38862: --- I removed the invalid versions from `Affe

[jira] [Updated] (SPARK-38862) Basic Authentication or Token Based Authentication for The REST Submission Server

2022-07-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38862: -- Target Version/s: (was: 3.3.0, 3.2.2) > Basic Authentication or Token Based Authentication f

[jira] [Updated] (SPARK-38862) Basic Authentication or Token Based Authentication for The REST Submission Server

2022-07-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38862: -- Affects Version/s: 3.4.0 (was: 3.0.0) (wa

[jira] [Commented] (SPARK-39736) Enable base image build in SparkR job

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17565052#comment-17565052 ] Apache Spark commented on SPARK-39736: -- User 'Yikun' has created a pull request for

[jira] [Assigned] (SPARK-39736) Enable base image build in SparkR job

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39736: Assignee: Apache Spark > Enable base image build in SparkR job >

[jira] [Assigned] (SPARK-39736) Enable base image build in SparkR job

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39736: Assignee: (was: Apache Spark) > Enable base image build in SparkR job > -

[jira] [Resolved] (SPARK-39667) Add another workaround when there is not enough memory to build and broadcast the table

2022-07-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39667. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37069 [https://gith

[jira] [Assigned] (SPARK-39667) Add another workaround when there is not enough memory to build and broadcast the table

2022-07-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-39667: --- Assignee: Yuming Wang > Add another workaround when there is not enough memory to build and

[jira] [Commented] (SPARK-39744) Add the REGEXP_INSTR function

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564934#comment-17564934 ] Apache Spark commented on SPARK-39744: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-39744) Add the REGEXP_INSTR function

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39744: Assignee: Max Gekk (was: Apache Spark) > Add the REGEXP_INSTR function > ---

[jira] [Assigned] (SPARK-39744) Add the REGEXP_INSTR function

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39744: Assignee: Apache Spark (was: Max Gekk) > Add the REGEXP_INSTR function > ---

[jira] [Updated] (SPARK-39744) Add the REGEXP_INSTR function

2022-07-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39744: - Description: The function should return the position of the specified occurrence of the regular express

[jira] [Commented] (SPARK-39742) Request executor after kill executor, the number of executors is not as expected

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564930#comment-17564930 ] Apache Spark commented on SPARK-39742: -- User 'zml1206' has created a pull request f

[jira] [Commented] (SPARK-35242) Support change catalog default database for spark

2022-07-11 Thread Gabor Roczei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564931#comment-17564931 ] Gabor Roczei commented on SPARK-35242: -- Ok, thanks [~hongdongdong]! > Support chan

[jira] [Assigned] (SPARK-39742) Request executor after kill executor, the number of executors is not as expected

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39742: Assignee: (was: Apache Spark) > Request executor after kill executor, the number of e

[jira] [Assigned] (SPARK-39742) Request executor after kill executor, the number of executors is not as expected

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39742: Assignee: Apache Spark > Request executor after kill executor, the number of executors is

[jira] [Created] (SPARK-39744) Add the REGEXP_INSTR function

2022-07-11 Thread Max Gekk (Jira)
Max Gekk created SPARK-39744: Summary: Add the REGEXP_INSTR function Key: SPARK-39744 URL: https://issues.apache.org/jira/browse/SPARK-39744 Project: Spark Issue Type: New Feature Compo

[jira] [Updated] (SPARK-39744) Add the REGEXP_INSTR function

2022-07-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39744: - Fix Version/s: (was: 3.4.0) > Add the REGEXP_INSTR function > - > >

[jira] [Commented] (SPARK-39735) Enable base image build in lint job and fix sparkr env

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564916#comment-17564916 ] Apache Spark commented on SPARK-39735: -- User 'Yikun' has created a pull request for

[jira] [Resolved] (SPARK-39739) Upgrade sbt to 1.7.0

2022-07-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39739. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37151 [https://gi

[jira] [Assigned] (SPARK-39739) Upgrade sbt to 1.7.0

2022-07-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39739: Assignee: Yang Jie > Upgrade sbt to 1.7.0 > > > Key:

[jira] [Updated] (SPARK-39743) Unable to set zstd compression level while writing parquet files

2022-07-11 Thread Yeachan Park (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeachan Park updated SPARK-39743: - Summary: Unable to set zstd compression level while writing parquet files (was: Unable to set z

[jira] [Created] (SPARK-39743) Unable to set zstd compression level while writing parquet

2022-07-11 Thread Yeachan Park (Jira)
Yeachan Park created SPARK-39743: Summary: Unable to set zstd compression level while writing parquet Key: SPARK-39743 URL: https://issues.apache.org/jira/browse/SPARK-39743 Project: Spark Is

[jira] [Commented] (SPARK-39619) PrometheusServlet: add "TYPE" comment to exposed metrics

2022-07-11 Thread Eric Barault (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564892#comment-17564892 ] Eric Barault commented on SPARK-39619: -- A PR was provided here:  https://github.com

[jira] [Updated] (SPARK-39721) Deprecate databaseName in listColumns if needed

2022-07-11 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-39721: -- Summary: Deprecate databaseName in listColumns if needed (was: Add getTable/getDatabase/getFu

[jira] [Updated] (SPARK-39721) Deprecate databaseName in listColumns in SparkR if needed

2022-07-11 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-39721: -- Summary: Deprecate databaseName in listColumns in SparkR if needed (was: Deprecate databaseNa

[jira] [Reopened] (SPARK-39721) Deprecate databaseName in listColumns in SparkR if needed

2022-07-11 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reopened SPARK-39721: --- > Deprecate databaseName in listColumns in SparkR if needed > --

[jira] [Created] (SPARK-39742) Request executor after kill executor, the number of executors is not as expected

2022-07-11 Thread zhuml (Jira)
zhuml created SPARK-39742: - Summary: Request executor after kill executor, the number of executors is not as expected Key: SPARK-39742 URL: https://issues.apache.org/jira/browse/SPARK-39742 Project: Spark

[jira] [Commented] (SPARK-26052) Spark should output a _SUCCESS file for every partition correctly written

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564878#comment-17564878 ] Apache Spark commented on SPARK-26052: -- User 'danielhaviv' has created a pull reque

[jira] [Commented] (SPARK-26052) Spark should output a _SUCCESS file for every partition correctly written

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564877#comment-17564877 ] Apache Spark commented on SPARK-26052: -- User 'danielhaviv' has created a pull reque

[jira] [Commented] (SPARK-39741) Support url encode/decode as built-in function

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564832#comment-17564832 ] Apache Spark commented on SPARK-39741: -- User 'Yikf' has created a pull request for

[jira] [Assigned] (SPARK-39741) Support url encode/decode as built-in function

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39741: Assignee: (was: Apache Spark) > Support url encode/decode as built-in function >

[jira] [Assigned] (SPARK-39741) Support url encode/decode as built-in function

2022-07-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39741: Assignee: Apache Spark > Support url encode/decode as built-in function > ---

[jira] [Created] (SPARK-39741) Support url encode/decode as built-in function

2022-07-11 Thread Yi kaifei (Jira)
Yi kaifei created SPARK-39741: - Summary: Support url encode/decode as built-in function Key: SPARK-39741 URL: https://issues.apache.org/jira/browse/SPARK-39741 Project: Spark Issue Type: New Feat

[jira] [Assigned] (SPARK-39728) Test for parity of SQL functions between Python and JVM DataFrame API's

2022-07-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39728: Assignee: Andrew Ray > Test for parity of SQL functions between Python and JVM DataFrame

[jira] [Resolved] (SPARK-39728) Test for parity of SQL functions between Python and JVM DataFrame API's

2022-07-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39728. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37144 [https://gi

[jira] [Resolved] (SPARK-39735) Enable base image build in lint job and fix sparkr env

2022-07-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39735. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37149 [https://gi

[jira] [Assigned] (SPARK-39735) Enable base image build in lint job and fix sparkr env

2022-07-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39735: Assignee: Yikun Jiang > Enable base image build in lint job and fix sparkr env >

[jira] [Created] (SPARK-39740) vis-timeline @ 4.2.1 vulnerable to XSS attacks

2022-07-11 Thread Eugene Shinn (Truveta) (Jira)
Eugene Shinn (Truveta) created SPARK-39740: -- Summary: vis-timeline @ 4.2.1 vulnerable to XSS attacks Key: SPARK-39740 URL: https://issues.apache.org/jira/browse/SPARK-39740 Project: Spark