[jira] [Updated] (SPARK-30810) Allows to parse a Dataset having different column from 'value' in csv(dataset) API

2020-02-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-30810: - Summary: Allows to parse a Dataset having different column from 'value' in csv(dataset) API

[jira] [Updated] (SPARK-30810) Allows to parse a Dataset having different column from 'value'

2020-02-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-30810: - Issue Type: Bug (was: Improvement) > Allows to parse a Dataset having different column from

[jira] [Resolved] (SPARK-30528) Potential performance regression with DPP subquery duplication

2020-02-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30528. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27551

[jira] [Assigned] (SPARK-30528) Potential performance regression with DPP subquery duplication

2020-02-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30528: --- Assignee: Wei Xue > Potential performance regression with DPP subquery duplication >

[jira] [Commented] (SPARK-16387) Reserved SQL words are not escaped by JDBC writer

2020-02-13 Thread Izek Greenfield (Jira)
[ https://issues.apache.org/jira/browse/SPARK-16387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036203#comment-17036203 ] Izek Greenfield commented on SPARK-16387: - Hi [~dongjoon] thanks for the quick response. we

[jira] [Created] (SPARK-30810) Allows to parse a Dataset having different column from 'value'

2020-02-13 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-30810: Summary: Allows to parse a Dataset having different column from 'value' Key: SPARK-30810 URL: https://issues.apache.org/jira/browse/SPARK-30810 Project: Spark

[jira] [Resolved] (SPARK-30758) Spark SQL can't display bracketed comments well in generated golden files

2020-02-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30758. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27481

[jira] [Assigned] (SPARK-30758) Spark SQL can't display bracketed comments well in generated golden files

2020-02-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30758: --- Assignee: jiaan.geng > Spark SQL can't display bracketed comments well in generated golden

[jira] [Resolved] (SPARK-30613) support hive style REPLACE COLUMN syntax

2020-02-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30613. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27482

[jira] [Assigned] (SPARK-30613) support hive style REPLACE COLUMN syntax

2020-02-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30613: --- Assignee: Terry Kim > support hive style REPLACE COLUMN syntax >

[jira] [Assigned] (SPARK-30811) CTE that refers to non-existent table with same name causes StackOverflowError

2020-02-13 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-30811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-30811: - Assignee: Herman van Hövell > CTE that refers to non-existent table with same

[jira] [Created] (SPARK-30811) CTE that refers to non-existent table with same name causes StackOverflowError

2020-02-13 Thread Jira
Herman van Hövell created SPARK-30811: - Summary: CTE that refers to non-existent table with same name causes StackOverflowError Key: SPARK-30811 URL: https://issues.apache.org/jira/browse/SPARK-30811

[jira] [Created] (SPARK-30812) Revise boolean config name according to new config naming policy

2020-02-13 Thread wuyi (Jira)
wuyi created SPARK-30812: Summary: Revise boolean config name according to new config naming policy Key: SPARK-30812 URL: https://issues.apache.org/jira/browse/SPARK-30812 Project: Spark Issue

[jira] [Updated] (SPARK-30811) CTE that refers to non-existent table with same name causes StackOverflowError

2020-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30811: -- Affects Version/s: 2.3.4 > CTE that refers to non-existent table with same name causes

[jira] [Created] (SPARK-30813) Matrices.sprand mistakes in comments

2020-02-13 Thread Xiaochang Wu (Jira)
Xiaochang Wu created SPARK-30813: Summary: Matrices.sprand mistakes in comments Key: SPARK-30813 URL: https://issues.apache.org/jira/browse/SPARK-30813 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-30762) Add dtype="float32" support to vector_to_array UDF

2020-02-13 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-30762: --- Fix Version/s: (was: 3.1.0) (was: 3.0.0) > Add dtype="float32" support

[jira] [Updated] (SPARK-30762) Add dtype="float32" support to vector_to_array UDF

2020-02-13 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-30762: --- Fix Version/s: 3.1.0 3.0.0 > Add dtype="float32" support to vector_to_array UDF

[jira] [Resolved] (SPARK-30762) Add dtype="float32" support to vector_to_array UDF

2020-02-13 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-30762. Target Version/s: 3.0.0, 3.1.0 Resolution: Done Resolved by

[jira] [Resolved] (SPARK-29231) Constraints should be inferred from cast equality constraint

2020-02-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29231. - Fix Version/s: 3.1.0 Assignee: Yuming Wang Resolution: Fixed > Constraints

[jira] [Commented] (SPARK-28119) Cannot read environment variable inside custom property file

2020-02-13 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-28119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036325#comment-17036325 ] MINET J-Sébastien commented on SPARK-28119: --- Seems that nobody care ;) Anyway I found a

[jira] [Comment Edited] (SPARK-28119) Cannot read environment variable inside custom property file

2020-02-13 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-28119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036325#comment-17036325 ] MINET J-Sébastien edited comment on SPARK-28119 at 2/13/20 3:56 PM:

[jira] [Comment Edited] (SPARK-28119) Cannot read environment variable inside custom property file

2020-02-13 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-28119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036325#comment-17036325 ] MINET J-Sébastien edited comment on SPARK-28119 at 2/13/20 3:57 PM:

[jira] [Updated] (SPARK-30811) CTE that refers to non-existent table with same name causes StackOverflowError

2020-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30811: -- Affects Version/s: 2.2.3 > CTE that refers to non-existent table with same name causes

[jira] [Updated] (SPARK-30811) CTE that refers to non-existent table with same name causes StackOverflowError

2020-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30811: -- Affects Version/s: 2.1.3 > CTE that refers to non-existent table with same name causes

[jira] [Updated] (SPARK-30811) CTE that refers to non-existent table with same name causes StackOverflowError

2020-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30811: -- Affects Version/s: 2.0.2 > CTE that refers to non-existent table with same name causes

[jira] [Updated] (SPARK-30821) Executor pods with multiple containers will not be rescheduled unless all containers fail

2020-02-13 Thread Kevin Hogeland (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Hogeland updated SPARK-30821: --- Summary: Executor pods with multiple containers will not be rescheduled unless all

[jira] [Updated] (SPARK-30823) %PYTHONPATH% not set in python/docs/make2.bat, resulting in failed/wrong documentation builds

2020-02-13 Thread David Toneian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Toneian updated SPARK-30823: -- Description: When building the PySpark documentation on Windows, by changing directory to

[jira] [Assigned] (SPARK-30703) Add a documentation page for ANSI mode

2020-02-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-30703: -- Assignee: Takeshi Yamamuro > Add a documentation page for ANSI mode >

[jira] [Created] (SPARK-30815) Function to format timestamp with time zone

2020-02-13 Thread Enrico Minack (Jira)
Enrico Minack created SPARK-30815: - Summary: Function to format timestamp with time zone Key: SPARK-30815 URL: https://issues.apache.org/jira/browse/SPARK-30815 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-30703) Add a documentation page for ANSI mode

2020-02-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-30703. Resolution: Fixed This issue is resolved by https://github.com/apache/spark/pull/27489 >

[jira] [Created] (SPARK-30816) Fix dev-run-integration-tests.sh to ignore empty param correctly

2020-02-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-30816: - Summary: Fix dev-run-integration-tests.sh to ignore empty param correctly Key: SPARK-30816 URL: https://issues.apache.org/jira/browse/SPARK-30816 Project: Spark

[jira] [Commented] (SPARK-30814) Add Columns references should be able to resolve each other

2020-02-13 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036436#comment-17036436 ] Terry Kim commented on SPARK-30814: --- Yea, I can work on this. > Add Columns references should be able

[jira] [Created] (SPARK-30817) SparkR ML algorithms parity

2020-02-13 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30817: -- Summary: SparkR ML algorithms parity Key: SPARK-30817 URL: https://issues.apache.org/jira/browse/SPARK-30817 Project: Spark Issue Type:

[jira] [Updated] (SPARK-30821) Sidecar containers in executor/driver may fail silently

2020-02-13 Thread Kevin Hogeland (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Hogeland updated SPARK-30821: --- Description: Since the restart policy of launched pods is Never, additional handling is

[jira] [Resolved] (SPARK-30816) Fix dev-run-integration-tests.sh to ignore empty param correctly

2020-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30816. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27566

[jira] [Assigned] (SPARK-30816) Fix dev-run-integration-tests.sh to ignore empty param correctly

2020-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30816: - Assignee: Dongjoon Hyun > Fix dev-run-integration-tests.sh to ignore empty param

[jira] [Commented] (SPARK-30814) Add Columns references should be able to resolve each other

2020-02-13 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036418#comment-17036418 ] Burak Yavuz commented on SPARK-30814: - cc [~cloud_fan] [~imback82], can we prioritize this over

[jira] [Created] (SPARK-30814) Add Columns references should be able to resolve each other

2020-02-13 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-30814: --- Summary: Add Columns references should be able to resolve each other Key: SPARK-30814 URL: https://issues.apache.org/jira/browse/SPARK-30814 Project: Spark

[jira] [Resolved] (SPARK-30807) Support JDK11 in K8S integration test

2020-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30807. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27559

[jira] [Created] (SPARK-30819) Add FMRegressor wrapper to SparkR

2020-02-13 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30819: -- Summary: Add FMRegressor wrapper to SparkR Key: SPARK-30819 URL: https://issues.apache.org/jira/browse/SPARK-30819 Project: Spark Issue Type:

[jira] [Created] (SPARK-30818) Add LinearRegression wrapper to SparkR

2020-02-13 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30818: -- Summary: Add LinearRegression wrapper to SparkR Key: SPARK-30818 URL: https://issues.apache.org/jira/browse/SPARK-30818 Project: Spark Issue

[jira] [Resolved] (SPARK-30751) Combine the skewed readers into one in AQE skew join optimizations

2020-02-13 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-30751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-30751. --- Fix Version/s: 3.0.0 Resolution: Fixed > Combine the skewed readers into one

[jira] [Assigned] (SPARK-30751) Combine the skewed readers into one in AQE skew join optimizations

2020-02-13 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-30751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-30751: - Assignee: Wenchen Fan > Combine the skewed readers into one in AQE skew join

[jira] [Created] (SPARK-30823) %PYTHONPATH% not set in python/docs/make2.bat, resulting in failed/wrong documentation builds

2020-02-13 Thread David Toneian (Jira)
David Toneian created SPARK-30823: - Summary: %PYTHONPATH% not set in python/docs/make2.bat, resulting in failed/wrong documentation builds Key: SPARK-30823 URL: https://issues.apache.org/jira/browse/SPARK-30823

[jira] [Created] (SPARK-30820) Add FMClassifier to SparkR

2020-02-13 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30820: -- Summary: Add FMClassifier to SparkR Key: SPARK-30820 URL: https://issues.apache.org/jira/browse/SPARK-30820 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-30821) Sidecar containers in executor/driver may fail silently

2020-02-13 Thread Kevin Hogeland (Jira)
Kevin Hogeland created SPARK-30821: -- Summary: Sidecar containers in executor/driver may fail silently Key: SPARK-30821 URL: https://issues.apache.org/jira/browse/SPARK-30821 Project: Spark

[jira] [Updated] (SPARK-30821) Executor pods with multiple containers will not be rescheduled unless all containers fail

2020-02-13 Thread Kevin Hogeland (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Hogeland updated SPARK-30821: --- Description: Since the restart policy of launched pods is Never, additional handling is

[jira] [Resolved] (SPARK-30798) Scope Session.active in QueryExecution

2020-02-13 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-30798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-30798. --- Fix Version/s: 3.0.0 Assignee: Ali Afroozeh Resolution: Fixed >

[jira] [Resolved] (SPARK-30667) Support simple all gather in barrier task context

2020-02-13 Thread Xiangrui Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-30667. --- Resolution: Fixed > Support simple all gather in barrier task context >

[jira] [Assigned] (SPARK-30667) Support simple all gather in barrier task context

2020-02-13 Thread Xiangrui Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-30667: - Assignee: Sarth Frey > Support simple all gather in barrier task context >

[jira] [Updated] (SPARK-30667) Support simple all gather in barrier task context

2020-02-13 Thread Xiangrui Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-30667: -- Fix Version/s: 3.0.0 > Support simple all gather in barrier task context >

[jira] [Updated] (SPARK-30667) Support simple all gather in barrier task context

2020-02-13 Thread Xiangrui Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-30667: -- Target Version/s: 3.0.0 (was: 3.1.0) > Support simple all gather in barrier task context >

[jira] [Created] (SPARK-30824) Support submit sql content only contains comments.

2020-02-13 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-30824: -- Summary: Support submit sql content only contains comments. Key: SPARK-30824 URL: https://issues.apache.org/jira/browse/SPARK-30824 Project: Spark Issue Type:

[jira] [Commented] (SPARK-30769) insertInto() with existing column as partition key cause weird partition result

2020-02-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036686#comment-17036686 ] Hyukjin Kwon commented on SPARK-30769: -- Please avoid to set Critical+ which is reserved for

[jira] [Commented] (SPARK-30774) The default checkpointing interval is not as claimed in the comment.

2020-02-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036684#comment-17036684 ] Hyukjin Kwon commented on SPARK-30774: -- Can you show the reproducible codes to show the comment is

[jira] [Updated] (SPARK-30769) insertInto() with existing column as partition key cause weird partition result

2020-02-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-30769: - Priority: Major (was: Blocker) > insertInto() with existing column as partition key cause

[jira] [Updated] (SPARK-30825) Add documents information for window function.

2020-02-13 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30825: --- Summary: Add documents information for window function. (was: Add since information for window

[jira] [Resolved] (SPARK-30781) Missing SortedMap type in pyspark

2020-02-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30781. -- Resolution: Won't Fix > Missing SortedMap type in pyspark > -

[jira] [Commented] (SPARK-30781) Missing SortedMap type in pyspark

2020-02-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036683#comment-17036683 ] Hyukjin Kwon commented on SPARK-30781: -- Currently we don't have the plan to add this given that we

[jira] [Commented] (SPARK-30787) Add Generic Algorithm optimizer feature to spark-ml

2020-02-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036681#comment-17036681 ] Hyukjin Kwon commented on SPARK-30787: -- Can you ask it to the dev mailing list? > Add Generic

[jira] [Created] (SPARK-30826) LIKE returns wrong result from external table using parquet

2020-02-13 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30826: -- Summary: LIKE returns wrong result from external table using parquet Key: SPARK-30826 URL: https://issues.apache.org/jira/browse/SPARK-30826 Project: Spark

[jira] [Commented] (SPARK-30825) Add since information for window function.

2020-02-13 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036634#comment-17036634 ] jiaan.geng commented on SPARK-30825: I'm working on. > Add since information for window function. >

[jira] [Created] (SPARK-30825) Add since information for window function.

2020-02-13 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-30825: -- Summary: Add since information for window function. Key: SPARK-30825 URL: https://issues.apache.org/jira/browse/SPARK-30825 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-30799) "spark_catalog.t" should not be resolved to temp view

2020-02-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-30799: Summary: "spark_catalog.t" should not be resolved to temp view (was: CatalogAndIdentifier

[jira] [Assigned] (SPARK-30801) Subqueries should not be AQE-ed if main query is not

2020-02-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30801: --- Assignee: Wei Xue > Subqueries should not be AQE-ed if main query is not >

[jira] [Resolved] (SPARK-30801) Subqueries should not be AQE-ed if main query is not

2020-02-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30801. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27554

[jira] [Resolved] (SPARK-30805) Failed to get locally stored broadcast data: broadcast_30

2020-02-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30805. -- Resolution: Incomplete > Failed to get locally stored broadcast data: broadcast_30 >

[jira] [Commented] (SPARK-30805) Failed to get locally stored broadcast data: broadcast_30

2020-02-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036680#comment-17036680 ] Hyukjin Kwon commented on SPARK-30805: -- Firstly, please avoid to set Critical+ which is reserved

[jira] [Updated] (SPARK-30805) Failed to get locally stored broadcast data: broadcast_30

2020-02-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-30805: - Priority: Major (was: Blocker) > Failed to get locally stored broadcast data: broadcast_30 >

[jira] [Resolved] (SPARK-30748) Storage Memory in Spark Web UI means

2020-02-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30748. -- Resolution: Invalid Please ask questions to mailing lists. See

[jira] [Commented] (SPARK-30586) NPE in LiveRDDDistribution (AppStatusListener)

2020-02-13 Thread Saisai Shao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036734#comment-17036734 ] Saisai Shao commented on SPARK-30586: - We also met the same issue. Seems like the code doesn't check

[jira] [Comment Edited] (SPARK-30586) NPE in LiveRDDDistribution (AppStatusListener)

2020-02-13 Thread Saisai Shao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036734#comment-17036734 ] Saisai Shao edited comment on SPARK-30586 at 2/14/20 7:13 AM: -- We also met

[jira] [Created] (SPARK-30827) Direct relationship is not documented in configurations in "spark.history.*" namespace

2020-02-13 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-30827: Summary: Direct relationship is not documented in configurations in "spark.history.*" namespace Key: SPARK-30827 URL: https://issues.apache.org/jira/browse/SPARK-30827

[jira] [Updated] (SPARK-30827) Direct relationship is not documented in configurations in "spark.history.*" namespace

2020-02-13 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-30827: - Issue Type: Documentation (was: Bug) > Direct relationship is not documented in configurations

[jira] [Created] (SPARK-30822) Pyspark queries fail if terminated with a semicolon

2020-02-13 Thread Samuel Setegne (Jira)
Samuel Setegne created SPARK-30822: -- Summary: Pyspark queries fail if terminated with a semicolon Key: SPARK-30822 URL: https://issues.apache.org/jira/browse/SPARK-30822 Project: Spark

[jira] [Updated] (SPARK-30743) Use JRE instead of JDK in K8S integration test

2020-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30743: -- Fix Version/s: (was: 3.1.0) 3.0.0 > Use JRE instead of JDK in K8S

[jira] [Updated] (SPARK-30743) Use JRE instead of JDK in K8S integration test

2020-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30743: -- Parent: SPARK-29194 Issue Type: Sub-task (was: Improvement) > Use JRE instead of JDK

[jira] [Assigned] (SPARK-30807) Support JDK11 in K8S integration test

2020-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30807: - Assignee: Dongjoon Hyun > Support JDK11 in K8S integration test >

[jira] [Updated] (SPARK-30743) Use JRE instead of JDK in K8S integration test

2020-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30743: -- Affects Version/s: (was: 3.1.0) 3.0.0 > Use JRE instead of JDK in

[jira] [Created] (SPARK-30808) Thrift server returns wrong timestamps/dates strings before 1582

2020-02-13 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30808: -- Summary: Thrift server returns wrong timestamps/dates strings before 1582 Key: SPARK-30808 URL: https://issues.apache.org/jira/browse/SPARK-30808 Project: Spark

[jira] [Updated] (SPARK-30807) Support JDK11 in K8S integration test

2020-02-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30807: -- Summary: Support JDK11 in K8S integration test (was: Support JDK11 test in K8S integration

[jira] [Created] (SPARK-30807) Support JDK11 test in K8S integration test

2020-02-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-30807: - Summary: Support JDK11 test in K8S integration test Key: SPARK-30807 URL: https://issues.apache.org/jira/browse/SPARK-30807 Project: Spark Issue Type:

[jira] [Created] (SPARK-30809) Review and fix issues in SQL and Core API docs

2020-02-13 Thread Yuanjian Li (Jira)
Yuanjian Li created SPARK-30809: --- Summary: Review and fix issues in SQL and Core API docs Key: SPARK-30809 URL: https://issues.apache.org/jira/browse/SPARK-30809 Project: Spark Issue Type:

[jira] [Updated] (SPARK-30809) Review and fix issues in SQL API docs

2020-02-13 Thread Yuanjian Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-30809: Summary: Review and fix issues in SQL API docs (was: Review and fix issues in SQL and Core API

[jira] [Updated] (SPARK-30809) Review and fix issues in SQL API docs

2020-02-13 Thread Yuanjian Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-30809: Component/s: (was: Spark Core) > Review and fix issues in SQL API docs >