[jira] [Updated] (SPARK-32268) Bloom Filter Join

2020-07-09 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32268: Attachment: q16-default.png q16-bloom-filter.png > Bloom Filter Join >

[jira] [Created] (SPARK-32268) Bloom Filter Join

2020-07-09 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-32268: --- Summary: Bloom Filter Join Key: SPARK-32268 URL: https://issues.apache.org/jira/browse/SPARK-32268 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-32250) Reenable MasterSuite's "Master should avoid dead loop while launching executor failed in Worker"

2020-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32250: - Description: It was disabled because this test alone was flaky. We should enable it back in

[jira] [Commented] (SPARK-32250) Reenable MasterSuite's "Master should avoid dead loop while launching executor failed in Worker"

2020-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17155133#comment-17155133 ] Hyukjin Kwon commented on SPARK-32250: -- cc [~Ngone51] FYI > Reenable MasterSuite's "Master should

[jira] [Commented] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

2020-07-09 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17155094#comment-17155094 ] Takeshi Yamamuro commented on SPARK-32257: -- Thanks, [~beliefer]. Please ping me for reviews. >

[jira] [Assigned] (SPARK-32237) Cannot resolve column when put hint in the views of common table expression

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32237: Assignee: (was: Apache Spark) > Cannot resolve column when put hint in the views of

[jira] [Assigned] (SPARK-32237) Cannot resolve column when put hint in the views of common table expression

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32237: Assignee: Apache Spark > Cannot resolve column when put hint in the views of common

[jira] [Commented] (SPARK-32237) Cannot resolve column when put hint in the views of common table expression

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17155093#comment-17155093 ] Apache Spark commented on SPARK-32237: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-32237) Cannot resolve column when put hint in the views of common table expression

2020-07-09 Thread Lantao Jin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17155085#comment-17155085 ] Lantao Jin edited comment on SPARK-32237 at 7/10/20, 4:21 AM: -- Thanks to

[jira] [Assigned] (SPARK-32242) Fix flakiness of CliSuite

2020-07-09 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-32242: Assignee: Jungtaek Lim > Fix flakiness of CliSuite > - > >

[jira] [Resolved] (SPARK-32242) Fix flakiness of CliSuite

2020-07-09 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-32242. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29036

[jira] [Commented] (SPARK-32237) Cannot resolve column when put hint in the views of common table expression

2020-07-09 Thread Lantao Jin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17155085#comment-17155085 ] Lantao Jin commented on SPARK-32237: Thanks to report this. I am going to fix that. > Cannot

[jira] [Comment Edited] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

2020-07-09 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17155068#comment-17155068 ] jiaan.geng edited comment on SPARK-32257 at 7/10/20, 3:35 AM: --

[jira] [Commented] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

2020-07-09 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17155068#comment-17155068 ] jiaan.geng commented on SPARK-32257: [~smilegator]OK. Let me do it. > [SQL Parser] Report Error for

[jira] [Updated] (SPARK-32238) Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

2020-07-09 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-32238: - Issue Type: Bug (was: Improvement) > Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

[jira] [Updated] (SPARK-32238) Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32238: -- Description: {code:java} object MalformedClassObject extends Serializable { class

[jira] [Updated] (SPARK-32238) Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32238: -- Description: *BEFORE* {code:java} object MalformedClassObject extends Serializable {

[jira] [Updated] (SPARK-32238) "Malformed class name" error from ScalaUDF

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32238: -- Affects Version/s: (was: 2.4.0) (was: 3.0.0)

[jira] [Updated] (SPARK-32238) "Malformed class name" error from ScalaUDF

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32238: -- Priority: Minor (was: Major) > "Malformed class name" error from ScalaUDF >

[jira] [Resolved] (SPARK-32224) Support pass 'spark.yarn.priority' through the SparkSubmit on Yarn modes

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32224. --- Resolution: Won't Do Like `spark.yarn.tags`, we had better use a general conf, `--conf

[jira] [Closed] (SPARK-32224) Support pass 'spark.yarn.priority' through the SparkSubmit on Yarn modes

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-32224. - > Support pass 'spark.yarn.priority' through the SparkSubmit on Yarn modes >

[jira] [Resolved] (SPARK-32207) Support 'F'-suffixed Float Literals

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32207. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29022

[jira] [Commented] (SPARK-32267) Decrease parallelism of PySpark tests on Jenkins

2020-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17155052#comment-17155052 ] Hyukjin Kwon commented on SPARK-32267: -- Seems the situation got better after Jenkins rebooting. I

[jira] [Resolved] (SPARK-32267) Decrease parallelism of PySpark tests on Jenkins

2020-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32267. -- Resolution: Later > Decrease parallelism of PySpark tests on Jenkins >

[jira] [Created] (SPARK-32267) Decrease parallelism of PySpark tests on Jenkins

2020-07-09 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32267: Summary: Decrease parallelism of PySpark tests on Jenkins Key: SPARK-32267 URL: https://issues.apache.org/jira/browse/SPARK-32267 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32267) Decrease parallelism of PySpark tests on Jenkins

2020-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32267: - Issue Type: Test (was: Improvement) > Decrease parallelism of PySpark tests on Jenkins >

[jira] [Updated] (SPARK-32266) Run smoke tests after a commit is pushed

2020-07-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-32266: --- Affects Version/s: 2.4.6 3.0.0 > Run smoke tests after a commit is

[jira] [Updated] (SPARK-32265) PySpark regexp_replace does not work as expected for the following pattern

2020-07-09 Thread Marco Vieira (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Vieira updated SPARK-32265: - Description: I'm using spark streaming to consume from a topic and make transformations on the

[jira] [Created] (SPARK-32265) PySpark regexp_replace does not work as expected for the following pattern

2020-07-09 Thread Marco Vieira (Jira)
Marco Vieira created SPARK-32265: Summary: PySpark regexp_replace does not work as expected for the following pattern Key: SPARK-32265 URL: https://issues.apache.org/jira/browse/SPARK-32265 Project:

[jira] [Assigned] (SPARK-31875) Provide a option to disable user supplied Hints.

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31875: - Assignee: Dilip Biswal > Provide a option to disable user supplied Hints. >

[jira] [Commented] (SPARK-32256) Hive may fail to detect Hadoop version when using isolated classloader

2020-07-09 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17155018#comment-17155018 ] Shixiong Zhu commented on SPARK-32256: -- Yep. This doesn't happen in Hadoop 3.1.0 and above > Hive

[jira] [Commented] (SPARK-32206) Enable multi-line true could break the read csv in Azure Data Lake Storage gen2

2020-07-09 Thread Qionghui Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17155016#comment-17155016 ] Qionghui Zhang commented on SPARK-32206: [~JinxinTang] I'm using Windows 10 and we are not

[jira] [Commented] (SPARK-32244) Build and run the Spark with test cases in Github Actions

2020-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17155011#comment-17155011 ] Hyukjin Kwon commented on SPARK-32244: -- Oh sure, let me create a JIRA for that too. > Build and

[jira] [Created] (SPARK-32262) PySpark regexp_replace not replacing JSON çlçlçl

2020-07-09 Thread Marco Vieira (Jira)
Marco Vieira created SPARK-32262: Summary: PySpark regexp_replace not replacing JSON çlçlçl Key: SPARK-32262 URL: https://issues.apache.org/jira/browse/SPARK-32262 Project: Spark Issue Type:

[jira] [Created] (SPARK-32263) PySpark regexp_replace not replacing JSON çlçlçlçl

2020-07-09 Thread Marco Vieira (Jira)
Marco Vieira created SPARK-32263: Summary: PySpark regexp_replace not replacing JSON çlçlçlçl Key: SPARK-32263 URL: https://issues.apache.org/jira/browse/SPARK-32263 Project: Spark Issue

[jira] [Created] (SPARK-32260) PySpark regexp_replace not replacing JSON çlçl

2020-07-09 Thread Marco Vieira (Jira)
Marco Vieira created SPARK-32260: Summary: PySpark regexp_replace not replacing JSON çlçl Key: SPARK-32260 URL: https://issues.apache.org/jira/browse/SPARK-32260 Project: Spark Issue Type:

[jira] [Created] (SPARK-32261) PySpark regexp_replace not replacing JSON çlçlçl

2020-07-09 Thread Marco Vieira (Jira)
Marco Vieira created SPARK-32261: Summary: PySpark regexp_replace not replacing JSON çlçlçl Key: SPARK-32261 URL: https://issues.apache.org/jira/browse/SPARK-32261 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32228) Partition column of hive table was capitalized and stored on HDFS

2020-07-09 Thread Kernel Force (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kernel Force updated SPARK-32228: - Description: Suppose we have a target hive table to be insert by spark with dynamic partition

[jira] [Commented] (SPARK-32220) Cartesian Product Hint cause data error

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154963#comment-17154963 ] Dongjoon Hyun commented on SPARK-32220: --- According to the PR test case, I labeled this as a

[jira] [Updated] (SPARK-32220) Cartesian Product Hint cause data error

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32220: -- Target Version/s: 3.0.1 > Cartesian Product Hint cause data error >

[jira] [Updated] (SPARK-32220) Cartesian Product Hint cause data error

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32220: -- Priority: Blocker (was: Major) > Cartesian Product Hint cause data error >

[jira] [Updated] (SPARK-32220) Cartesian Product Hint cause data error

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32220: -- Labels: correctness (was: ) > Cartesian Product Hint cause data error >

[jira] [Commented] (SPARK-32259) tmpfs=true, not pointing to SPARK_LOCAL_DIRS in k8s

2020-07-09 Thread Prakash Rajendran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154953#comment-17154953 ] Prakash Rajendran commented on SPARK-32259: --- [~rvesse] Hi Can you help on this? If you need

[jira] [Updated] (SPARK-32259) tmpfs=true, not pointing to SPARK_LOCAL_DIRS in k8s

2020-07-09 Thread Prakash Rajendran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Rajendran updated SPARK-32259: -- Description: In Spark-Submit, I have these config 

[jira] [Updated] (SPARK-32259) tmpfs=true, not pointing to SPARK_LOCAL_DIRS in k8s

2020-07-09 Thread Prakash Rajendran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Rajendran updated SPARK-32259: -- Attachment: Capture.PNG > tmpfs=true, not pointing to SPARK_LOCAL_DIRS in k8s >

[jira] [Updated] (SPARK-32259) tmpfs=true, not pointing to SPARK_LOCAL_DIRS in k8s

2020-07-09 Thread Prakash Rajendran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Rajendran updated SPARK-32259: -- Description: In Spark-Submit, I have these config 

[jira] [Created] (SPARK-32259) tmpfs=true, not pointing to SPARK_LOCAL_DIRS in k8s

2020-07-09 Thread Prakash Rajendran (Jira)
Prakash Rajendran created SPARK-32259: - Summary: tmpfs=true, not pointing to SPARK_LOCAL_DIRS in k8s Key: SPARK-32259 URL: https://issues.apache.org/jira/browse/SPARK-32259 Project: Spark

[jira] [Resolved] (SPARK-31831) Flaky test: org.apache.spark.sql.hive.thriftserver.HiveSessionImplSuite.(It is not a test it is a sbt.testing.SuiteSelector)

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31831. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29039

[jira] [Assigned] (SPARK-31831) Flaky test: org.apache.spark.sql.hive.thriftserver.HiveSessionImplSuite.(It is not a test it is a sbt.testing.SuiteSelector)

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31831: - Assignee: Jungtaek Lim > Flaky test:

[jira] [Updated] (SPARK-31831) Flaky test: org.apache.spark.sql.hive.thriftserver.HiveSessionImplSuite.(It is not a test it is a sbt.testing.SuiteSelector)

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31831: -- Component/s: Tests > Flaky test:

[jira] [Commented] (SPARK-32258) NormalizeFloatingNumbers can directly normalize on certain children expressions

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154921#comment-17154921 ] Apache Spark commented on SPARK-32258: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-32258) NormalizeFloatingNumbers can directly normalize on certain children expressions

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154920#comment-17154920 ] Apache Spark commented on SPARK-32258: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32258) NormalizeFloatingNumbers can directly normalize on certain children expressions

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32258: Assignee: Apache Spark (was: L. C. Hsieh) > NormalizeFloatingNumbers can directly

[jira] [Assigned] (SPARK-32258) NormalizeFloatingNumbers can directly normalize on certain children expressions

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32258: Assignee: L. C. Hsieh (was: Apache Spark) > NormalizeFloatingNumbers can directly

[jira] [Created] (SPARK-32258) NormalizeFloatingNumbers can directly normalize on certain children expressions

2020-07-09 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-32258: --- Summary: NormalizeFloatingNumbers can directly normalize on certain children expressions Key: SPARK-32258 URL: https://issues.apache.org/jira/browse/SPARK-32258

[jira] [Assigned] (SPARK-32232) IllegalArgumentException: MultilayerPerceptronClassifier_... parameter solver given invalid value auto

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32232: Assignee: Apache Spark > IllegalArgumentException: MultilayerPerceptronClassifier_...

[jira] [Assigned] (SPARK-32232) IllegalArgumentException: MultilayerPerceptronClassifier_... parameter solver given invalid value auto

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32232: Assignee: (was: Apache Spark) > IllegalArgumentException:

[jira] [Commented] (SPARK-32232) IllegalArgumentException: MultilayerPerceptronClassifier_... parameter solver given invalid value auto

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154875#comment-17154875 ] Apache Spark commented on SPARK-32232: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32035) Inconsistent AWS environment variables in documentation

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32035: - Assignee: Richard Joerger > Inconsistent AWS environment variables in documentation >

[jira] [Resolved] (SPARK-32035) Inconsistent AWS environment variables in documentation

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32035. --- Fix Version/s: 3.1.0 2.4.7 3.0.1 Resolution:

[jira] [Commented] (SPARK-32232) IllegalArgumentException: MultilayerPerceptronClassifier_... parameter solver given invalid value auto

2020-07-09 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154755#comment-17154755 ] Huaxin Gao commented on SPARK-32232: [~st_60]No, I will not remove the getter. I think over, seems

[jira] [Resolved] (SPARK-32236) Local cluster should shutdown gracefully

2020-07-09 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-32236. Resolution: Duplicate > Local cluster should shutdown gracefully >

[jira] [Updated] (SPARK-32256) Hive may fail to detect Hadoop version when using isolated classloader

2020-07-09 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-32256: - Description: Spark allows the user to set `spark.sql.hive.metastore.jars` to specify jars to

[jira] [Updated] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

2020-07-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32257: Description: {code:java} SET spark.sql.ansi.enabled true{code} The above SQL command does not change

[jira] [Commented] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

2020-07-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154739#comment-17154739 ] Xiao Li commented on SPARK-32257: - [~beliefer] [~maropu] Are you interested in this? > [SQL Parser]

[jira] [Created] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

2020-07-09 Thread Xiao Li (Jira)
Xiao Li created SPARK-32257: --- Summary: [SQL Parser] Report Error for invalid usage of SET command Key: SPARK-32257 URL: https://issues.apache.org/jira/browse/SPARK-32257 Project: Spark Issue Type:

[jira] [Commented] (SPARK-32244) Build and run the Spark with test cases in Github Actions

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154738#comment-17154738 ] Dongjoon Hyun commented on SPARK-32244: --- BTW, where is the work item JIRA to contact APACHE INFRA

[jira] [Commented] (SPARK-32244) Build and run the Spark with test cases in Github Actions

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154736#comment-17154736 ] Dongjoon Hyun commented on SPARK-32244: --- It's a great plan! Thanks! > Build and run the Spark

[jira] [Assigned] (SPARK-32231) Use Hadoop 3 profile in AppVeyor SparkR build

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32231: - Assignee: Dongjoon Hyun (was: Apache Spark) > Use Hadoop 3 profile in AppVeyor SparkR

[jira] [Closed] (SPARK-32230) Use Hadoop 2.7 profile in AppVeyor SparkR build

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-32230. - > Use Hadoop 2.7 profile in AppVeyor SparkR build >

[jira] [Updated] (SPARK-32256) Hive may fail to detect Hadoop version when using isolated classloader

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32256: -- Target Version/s: 3.0.1 > Hive may fail to detect Hadoop version when using isolated

[jira] [Commented] (SPARK-32256) Hive may fail to detect Hadoop version when using isolated classloader

2020-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154730#comment-17154730 ] Dongjoon Hyun commented on SPARK-32256: --- Thank you so much, [~zsxwing]. According to the PR

[jira] [Updated] (SPARK-32256) Hive may fail to detect Hadoop version when using isolated classloader

2020-07-09 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-32256: - Description: Spark allows the user to set `spark.sql.hive.metastore.jars` to specify jars to

[jira] [Commented] (SPARK-32256) Hive may fail to detect Hadoop version when using isolated classloader

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154714#comment-17154714 ] Apache Spark commented on SPARK-32256: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32256) Hive may fail to detect Hadoop version when using isolated classloader

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32256: Assignee: Apache Spark (was: Shixiong Zhu) > Hive may fail to detect Hadoop version

[jira] [Commented] (SPARK-32256) Hive may fail to detect Hadoop version when using isolated classloader

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154713#comment-17154713 ] Apache Spark commented on SPARK-32256: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32256) Hive may fail to detect Hadoop version when using isolated classloader

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32256: Assignee: Shixiong Zhu (was: Apache Spark) > Hive may fail to detect Hadoop version

[jira] [Assigned] (SPARK-32035) Inconsistent AWS environment variables in documentation

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32035: Assignee: Apache Spark > Inconsistent AWS environment variables in documentation >

[jira] [Commented] (SPARK-32035) Inconsistent AWS environment variables in documentation

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154710#comment-17154710 ] Apache Spark commented on SPARK-32035: -- User 'Moovlin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32035) Inconsistent AWS environment variables in documentation

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32035: Assignee: (was: Apache Spark) > Inconsistent AWS environment variables in

[jira] [Assigned] (SPARK-32256) Hive may fail to detect Hadoop version when using isolated classloader

2020-07-09 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-32256: Assignee: Shixiong Zhu > Hive may fail to detect Hadoop version when using isolated

[jira] [Created] (SPARK-32256) Hive may fail to detect Hadoop version when using isolated classloader

2020-07-09 Thread Shixiong Zhu (Jira)
Shixiong Zhu created SPARK-32256: Summary: Hive may fail to detect Hadoop version when using isolated classloader Key: SPARK-32256 URL: https://issues.apache.org/jira/browse/SPARK-32256 Project:

[jira] [Updated] (SPARK-32255) Set jobs that runs periodically for other profile combinations

2020-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32255: - Parent: SPARK-32244 Issue Type: Sub-task (was: Improvement) > Set jobs that runs

[jira] [Created] (SPARK-32255) Set jobs that runs periodically for other profile combinations

2020-07-09 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32255: Summary: Set jobs that runs periodically for other profile combinations Key: SPARK-32255 URL: https://issues.apache.org/jira/browse/SPARK-32255 Project: Spark

[jira] [Updated] (SPARK-32253) Make readability better in the test result logs

2020-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32253: - Summary: Make readability better in the test result logs (was: Make logs readability better )

[jira] [Resolved] (SPARK-32254) Reenable SparkSQLEnvSuite's "external listeners should be initialized with Spark classloader"

2020-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32254. -- Resolution: Invalid I just decided to run other tests in parallel only except Hive for now.

[jira] [Resolved] (SPARK-32192) Print column name when throws ClassCastException

2020-07-09 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32192. -- Fix Version/s: (was: 2.4.3) 3.1.0 Resolution: Fixed Issue

[jira] [Assigned] (SPARK-32192) Print column name when throws ClassCastException

2020-07-09 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-32192: Assignee: xiepengjie > Print column name when throws ClassCastException >

[jira] [Created] (SPARK-32254) Reenable SparkSQLEnvSuite's "external listeners should be initialized with Spark classloader"

2020-07-09 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32254: Summary: Reenable SparkSQLEnvSuite's "external listeners should be initialized with Spark classloader" Key: SPARK-32254 URL: https://issues.apache.org/jira/browse/SPARK-32254

[jira] [Assigned] (SPARK-32245) Implement the base to run Spark tests in GitHun Actions

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32245: Assignee: Hyukjin Kwon (was: Apache Spark) > Implement the base to run Spark tests in

[jira] [Assigned] (SPARK-32245) Implement the base to run Spark tests in GitHun Actions

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32245: Assignee: Apache Spark (was: Hyukjin Kwon) > Implement the base to run Spark tests in

[jira] [Commented] (SPARK-32245) Implement the base to run Spark tests in GitHun Actions

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154601#comment-17154601 ] Apache Spark commented on SPARK-32245: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-32253) Make logs readability better

2020-07-09 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32253: Summary: Make logs readability better Key: SPARK-32253 URL: https://issues.apache.org/jira/browse/SPARK-32253 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-31753) Add missing keywords in the SQL documents

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154589#comment-17154589 ] Apache Spark commented on SPARK-31753: -- User 'GuoPhilipse' has created a pull request for this

[jira] [Commented] (SPARK-31753) Add missing keywords in the SQL documents

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154588#comment-17154588 ] Apache Spark commented on SPARK-31753: -- User 'GuoPhilipse' has created a pull request for this

[jira] [Assigned] (SPARK-31753) Add missing keywords in the SQL documents

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31753: Assignee: (was: Apache Spark) > Add missing keywords in the SQL documents >

[jira] [Assigned] (SPARK-31753) Add missing keywords in the SQL documents

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31753: Assignee: Apache Spark > Add missing keywords in the SQL documents >

[jira] [Commented] (SPARK-32244) Build and run the Spark with test cases in Github Actions

2020-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154583#comment-17154583 ] Hyukjin Kwon commented on SPARK-32244: -- cc [~dongjoon] [~Gengliang.Wang] FYI > Build and run the

[jira] [Assigned] (SPARK-32251) fix SQL keyword document

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32251: Assignee: Apache Spark (was: Wenchen Fan) > fix SQL keyword document >

[jira] [Assigned] (SPARK-32251) fix SQL keyword document

2020-07-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32251: Assignee: Wenchen Fan (was: Apache Spark) > fix SQL keyword document >

  1   2   >