[jira] [Created] (SPARK-34772) RebaseDateTime loadRebaseRecords should use Spark classloader instead of context

2021-03-17 Thread ulysses you (Jira)
ulysses you created SPARK-34772: --- Summary: RebaseDateTime loadRebaseRecords should use Spark classloader instead of context Key: SPARK-34772 URL: https://issues.apache.org/jira/browse/SPARK-34772

[jira] [Commented] (SPARK-34762) Many PR's Scala 2.13 build action failed

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303151#comment-17303151 ] Apache Spark commented on SPARK-34762: -- User 'sarutak' has created a pull request for this issue:

[jira] [Updated] (SPARK-34772) RebaseDateTime loadRebaseRecords should use Spark classloader instead of context

2021-03-17 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-34772: Description: With custom `spark.sql.hive.metastore.version` and `spark.sql.hive.metastore.jars`.

[jira] [Commented] (SPARK-34772) RebaseDateTime loadRebaseRecords should use Spark classloader instead of context

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303179#comment-17303179 ] Apache Spark commented on SPARK-34772: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-34770) InMemoryCatalog.tableExists should not fail if database doesn't exist

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303122#comment-17303122 ] Apache Spark commented on SPARK-34770: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34770) InMemoryCatalog.tableExists should not fail if database doesn't exist

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34770: Assignee: (was: Apache Spark) > InMemoryCatalog.tableExists should not fail if

[jira] [Commented] (SPARK-34739) Add an year-month interval to a timestamp

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303121#comment-17303121 ] Apache Spark commented on SPARK-34739: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34770) InMemoryCatalog.tableExists should not fail if database doesn't exist

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34770: Assignee: Apache Spark > InMemoryCatalog.tableExists should not fail if database doesn't

[jira] [Updated] (SPARK-34773) change-scala-version.sh fails to modify pom.xml if it changes the version from 2.13 to 2.12

2021-03-17 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34773: --- Summary: change-scala-version.sh fails to modify pom.xml if it changes the version from

[jira] [Updated] (SPARK-34772) RebaseDateTime loadRebaseRecords should use Spark classloader instead of context

2021-03-17 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-34772: Description: With custom `spark.sql.hive.metastore.version` and `spark.sql.hive.metastore.jars`.

[jira] [Resolved] (SPARK-34742) ANSI mode: Abs throws exception if input is out of range

2021-03-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34742. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31836

[jira] [Updated] (SPARK-34772) RebaseDateTime loadRebaseRecords should use Spark classloader instead of context

2021-03-17 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-34772: Description: We will use date formatter in `HiveShim` that convert `date` to `string`, if we set

[jira] [Updated] (SPARK-34774) The `change-scala- version.sh` script not replaced scala.version property correctly

2021-03-17 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-34774: - Issue Type: Bug (was: Improvement) > The `change-scala- version.sh` script not replaced scala.version

[jira] [Assigned] (SPARK-34762) Many PR's Scala 2.13 build action failed

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34762: Assignee: (was: Apache Spark) > Many PR's Scala 2.13 build action failed >

[jira] [Assigned] (SPARK-34762) Many PR's Scala 2.13 build action failed

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34762: Assignee: Apache Spark > Many PR's Scala 2.13 build action failed >

[jira] [Commented] (SPARK-34762) Many PR's Scala 2.13 build action failed

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303152#comment-17303152 ] Apache Spark commented on SPARK-34762: -- User 'sarutak' has created a pull request for this issue:

[jira] [Resolved] (SPARK-34575) Push down limit through window when partitionSpec is empty

2021-03-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34575. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31691

[jira] [Assigned] (SPARK-34575) Push down limit through window when partitionSpec is empty

2021-03-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34575: --- Assignee: Yuming Wang > Push down limit through window when partitionSpec is empty >

[jira] [Created] (SPARK-34771) Support UDT for Pandas

2021-03-17 Thread Darcy Shen (Jira)
Darcy Shen created SPARK-34771: -- Summary: Support UDT for Pandas Key: SPARK-34771 URL: https://issues.apache.org/jira/browse/SPARK-34771 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-34774) The `change-scala- version.sh` script not replaced scala.version property correctly

2021-03-17 Thread Yang Jie (Jira)
Yang Jie created SPARK-34774: Summary: The `change-scala- version.sh` script not replaced scala.version property correctly Key: SPARK-34774 URL: https://issues.apache.org/jira/browse/SPARK-34774 Project:

[jira] [Assigned] (SPARK-34773) change-scala-version.sh fails to modify pom.xml if it changes the version from 2.13 to 2.12

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34773: Assignee: Apache Spark (was: Kousuke Saruta) > change-scala-version.sh fails to modify

[jira] [Assigned] (SPARK-34772) RebaseDateTime loadRebaseRecords should use Spark classloader instead of context

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34772: Assignee: Apache Spark > RebaseDateTime loadRebaseRecords should use Spark classloader

[jira] [Assigned] (SPARK-34772) RebaseDateTime loadRebaseRecords should use Spark classloader instead of context

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34772: Assignee: (was: Apache Spark) > RebaseDateTime loadRebaseRecords should use Spark

[jira] [Assigned] (SPARK-34773) change-scala-version.sh fails to modify pom.xml if it changes the version from 2.13 to 2.12

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34773: Assignee: Kousuke Saruta (was: Apache Spark) > change-scala-version.sh fails to modify

[jira] [Commented] (SPARK-34773) change-scala-version.sh fails to modify pom.xml if it changes the version from 2.13 to 2.12

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303180#comment-17303180 ] Apache Spark commented on SPARK-34773: -- User 'sarutak' has created a pull request for this issue:

[jira] [Created] (SPARK-34773) change-scala-version fails to modify pom.xml if it changes the version from 2.13 to 2.12

2021-03-17 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34773: -- Summary: change-scala-version fails to modify pom.xml if it changes the version from 2.13 to 2.12 Key: SPARK-34773 URL: https://issues.apache.org/jira/browse/SPARK-34773

[jira] [Updated] (SPARK-34772) RebaseDateTime loadRebaseRecords should use Spark classloader instead of context

2021-03-17 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-34772: Description: We will use date formatter in `HiveShim` that convert `date` to `string`, if we set

[jira] [Updated] (SPARK-34772) RebaseDateTime loadRebaseRecords should use Spark classloader instead of context

2021-03-17 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-34772: Description: We will use date formatter in `HiveShim` that convert `date` to `string`, if we set

[jira] [Commented] (SPARK-34774) The `change-scala- version.sh` script not replaced scala.version property correctly

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303186#comment-17303186 ] Apache Spark commented on SPARK-34774: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-34774) The `change-scala- version.sh` script not replaced scala.version property correctly

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34774: Assignee: Apache Spark > The `change-scala- version.sh` script not replaced

[jira] [Assigned] (SPARK-34774) The `change-scala- version.sh` script not replaced scala.version property correctly

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34774: Assignee: (was: Apache Spark) > The `change-scala- version.sh` script not replaced

[jira] [Resolved] (SPARK-34699) 'CREATE TEMP VIEW USING' should use TemporaryViewRelation to store temp views

2021-03-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34699. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31825

[jira] [Assigned] (SPARK-34699) 'CREATE TEMP VIEW USING' should use TemporaryViewRelation to store temp views

2021-03-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34699: --- Assignee: Terry Kim > 'CREATE TEMP VIEW USING' should use TemporaryViewRelation to store

[jira] [Created] (SPARK-34776) Catalyst error on on certain struct operation (Couldn't find _gen_alias_)

2021-03-17 Thread Daniel Solow (Jira)
Daniel Solow created SPARK-34776: Summary: Catalyst error on on certain struct operation (Couldn't find _gen_alias_) Key: SPARK-34776 URL: https://issues.apache.org/jira/browse/SPARK-34776 Project:

[jira] [Commented] (SPARK-34749) Simplify CreateNamedStruct

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303441#comment-17303441 ] Apache Spark commented on SPARK-34749: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Resolved] (SPARK-33602) Group exception messages in execution/datasources

2021-03-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33602. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31757

[jira] [Assigned] (SPARK-33602) Group exception messages in execution/datasources

2021-03-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33602: --- Assignee: jiaan.geng > Group exception messages in execution/datasources >

[jira] [Commented] (SPARK-34558) warehouse path should be resolved ahead of populating and use

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303506#comment-17303506 ] Apache Spark commented on SPARK-34558: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Updated] (SPARK-34771) Support UDT for Pandas

2021-03-17 Thread Darcy Shen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darcy Shen updated SPARK-34771: --- Description: (spark) ➜ spark git:(SPARK_34771) ✗ bin/pyspark Python 3.8.8 (default, Feb 24 2021,

[jira] [Updated] (SPARK-34771) Support UDT for Pandas

2021-03-17 Thread Darcy Shen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darcy Shen updated SPARK-34771: --- Description: (spark) ➜ spark git:(SPARK_34771) ✗ bin/pyspark Python 3.8.8 (default, Feb 24 2021,

[jira] [Commented] (SPARK-27733) Upgrade to Avro 1.10.1

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303417#comment-17303417 ] Apache Spark commented on SPARK-27733: -- User 'iemejia' has created a pull request for this issue:

[jira] [Commented] (SPARK-33604) Group exception messages in sql/execution

2021-03-17 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303514#comment-17303514 ] jiaan.geng commented on SPARK-33604: I'm working on. > Group exception messages in sql/execution >

[jira] [Commented] (SPARK-33604) Group exception messages in sql/execution

2021-03-17 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303513#comment-17303513 ] jiaan.geng commented on SPARK-33604: I'm working on. > Group exception messages in sql/execution >

[jira] [Commented] (SPARK-24924) Add mapping for built-in Avro data source

2021-03-17 Thread Yu Xiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303213#comment-17303213 ] Yu Xiang commented on SPARK-24924: -- [~tgraves], [~Gengliang.Wang] [~dongjoon],  Hi, I am struggling

[jira] [Updated] (SPARK-34768) Respect the default input buffer size in Univocity

2021-03-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34768: - Fix Version/s: 3.0.3 3.1.2 3.2.0 > Respect the default

[jira] [Commented] (SPARK-34768) Respect the default input buffer size in Univocity

2021-03-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303295#comment-17303295 ] Hyukjin Kwon commented on SPARK-34768: -- Fixed in https://github.com/apache/spark/pull/31858 >

[jira] [Commented] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

2021-03-17 Thread Sergey (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303313#comment-17303313 ] Sergey commented on SPARK-34674: Sorry, I didn't search sufficiently for existing issues. There is

[jira] [Resolved] (SPARK-34749) Simplify CreateNamedStruct

2021-03-17 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34749. -- Fix Version/s: 3.2.0 Assignee: Wenchen Fan Resolution: Fixed Resolved

[jira] [Created] (SPARK-34775) Push down limit through window when partitionSpec is not empty

2021-03-17 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-34775: --- Summary: Push down limit through window when partitionSpec is not empty Key: SPARK-34775 URL: https://issues.apache.org/jira/browse/SPARK-34775 Project: Spark

[jira] [Comment Edited] (SPARK-27812) kubernetes client import non-daemon thread which block jvm exit.

2021-03-17 Thread Sergey (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303304#comment-17303304 ] Sergey edited comment on SPARK-27812 at 3/17/21, 11:18 AM: --- It seems, I have

[jira] [Resolved] (SPARK-34770) InMemoryCatalog.tableExists should not fail if database doesn't exist

2021-03-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34770. - Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-34770) InMemoryCatalog.tableExists should not fail if database doesn't exist

2021-03-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34770: --- Assignee: Wenchen Fan > InMemoryCatalog.tableExists should not fail if database doesn't

[jira] [Commented] (SPARK-20590) Map default input data source formats to inlined classes

2021-03-17 Thread Yu Xiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303237#comment-17303237 ] Yu Xiang commented on SPARK-20590: -- [~cloud_fan], I tried to use the full name as, it does not work.

[jira] [Assigned] (SPARK-34766) Do not capture maven config for views

2021-03-17 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-34766: Assignee: ulysses you > Do not capture maven config for views >

[jira] [Resolved] (SPARK-34766) Do not capture maven config for views

2021-03-17 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-34766. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31856

[jira] [Commented] (SPARK-34775) Push down limit through window when partitionSpec is not empty

2021-03-17 Thread Xuedong Luan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303270#comment-17303270 ] Xuedong Luan commented on SPARK-34775: -- I am working on this > Push down limit through window when

[jira] [Commented] (SPARK-34738) Upgrade Minikube and kubernetes cluster version on Jenkins

2021-03-17 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303287#comment-17303287 ] Attila Zsolt Piros commented on SPARK-34738: Thanks Shane! This sounds great! > Upgrade

[jira] [Resolved] (SPARK-34768) Respect the default input buffer size in Univocity

2021-03-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34768. -- Assignee: Hyukjin Kwon Resolution: Fixed > Respect the default input buffer size in

[jira] [Commented] (SPARK-27812) kubernetes client import non-daemon thread which block jvm exit.

2021-03-17 Thread Sergey (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303304#comment-17303304 ] Sergey commented on SPARK-27812: It seems, I have reproduced this bug in Spark 3.1.1. If I don't call

[jira] [Resolved] (SPARK-34758) Simplify Analyzer.resolveLiteralFunction

2021-03-17 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34758. -- Fix Version/s: 3.2.0 Assignee: Wenchen Fan Resolution: Fixed Resolved

[jira] [Updated] (SPARK-34777) [UI] StagePage input size records not show when records greater than zero

2021-03-17 Thread Zhongwei Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongwei Zhu updated SPARK-34777: - Attachment: No input size records.png > [UI] StagePage input size records not show when records

[jira] [Updated] (SPARK-34777) [UI] StagePage input size records not show when records greater than zero

2021-03-17 Thread Zhongwei Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongwei Zhu updated SPARK-34777: - Description: !No input size records.png|width=547,height=212! The `Input Size / Records`

[jira] [Created] (SPARK-34777) [UI] StagePage input size records not show when records greater than zero

2021-03-17 Thread Zhongwei Zhu (Jira)
Zhongwei Zhu created SPARK-34777: Summary: [UI] StagePage input size records not show when records greater than zero Key: SPARK-34777 URL: https://issues.apache.org/jira/browse/SPARK-34777 Project:

[jira] [Updated] (SPARK-34777) [UI] StagePage input size records not show when records greater than zero

2021-03-17 Thread Zhongwei Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongwei Zhu updated SPARK-34777: - Description: !No input size records.png|width=547,height=212! The `Input Size / Records`

[jira] [Assigned] (SPARK-34779) ExecutoMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34779: Assignee: (was: Apache Spark) > ExecutoMetricsPoller should keep stage entry in

[jira] [Assigned] (SPARK-34779) ExecutoMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34779: Assignee: Apache Spark > ExecutoMetricsPoller should keep stage entry in stageTCMP until

[jira] [Updated] (SPARK-34778) Upgrade to Avro 1.10.2

2021-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34778: -- Reporter: Ismaël Mejía (was: Dongjoon Hyun) > Upgrade to Avro 1.10.2 >

[jira] [Assigned] (SPARK-34778) Upgrade to Avro 1.10.2

2021-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34778: - Assignee: Ismaël Mejía > Upgrade to Avro 1.10.2 > -- > >

[jira] [Created] (SPARK-34779) ExecutoMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs

2021-03-17 Thread Baohe Zhang (Jira)
Baohe Zhang created SPARK-34779: --- Summary: ExecutoMetricsPoller should keep stage entry in stageTCMP until a heartbeat occurs Key: SPARK-34779 URL: https://issues.apache.org/jira/browse/SPARK-34779

[jira] [Commented] (SPARK-34777) [UI] StagePage input size records not show when records greater than zero

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303589#comment-17303589 ] Apache Spark commented on SPARK-34777: -- User 'warrenzhu25' has created a pull request for this

[jira] [Assigned] (SPARK-34777) [UI] StagePage input size records not show when records greater than zero

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34777: Assignee: Apache Spark > [UI] StagePage input size records not show when records greater

[jira] [Assigned] (SPARK-34777) [UI] StagePage input size records not show when records greater than zero

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34777: Assignee: (was: Apache Spark) > [UI] StagePage input size records not show when

[jira] [Created] (SPARK-34778) Upgrade to Avro 1.10.2

2021-03-17 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-34778: - Summary: Upgrade to Avro 1.10.2 Key: SPARK-34778 URL: https://issues.apache.org/jira/browse/SPARK-34778 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32288) [UI] Add exception summary table in stage page

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303628#comment-17303628 ] Apache Spark commented on SPARK-32288: -- User 'warrenzhu25' has created a pull request for this

[jira] [Assigned] (SPARK-34778) Upgrade to Avro 1.10.2

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34778: Assignee: Apache Spark (was: Ismaël Mejía) > Upgrade to Avro 1.10.2 >

[jira] [Assigned] (SPARK-34778) Upgrade to Avro 1.10.2

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34778: Assignee: Ismaël Mejía (was: Apache Spark) > Upgrade to Avro 1.10.2 >

[jira] [Commented] (SPARK-34778) Upgrade to Avro 1.10.2

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303629#comment-17303629 ] Apache Spark commented on SPARK-34778: -- User 'iemejia' has created a pull request for this issue:

[jira] [Commented] (SPARK-34737) Discrepancy between TIMESTAMP_SECONDS and cast from float

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303660#comment-17303660 ] Apache Spark commented on SPARK-34737: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34781) Eliminate LEFT SEMI/ANTI join to its left child side with AQE

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34781: Assignee: Apache Spark > Eliminate LEFT SEMI/ANTI join to its left child side with AQE >

[jira] [Assigned] (SPARK-34781) Eliminate LEFT SEMI/ANTI join to its left child side with AQE

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34781: Assignee: (was: Apache Spark) > Eliminate LEFT SEMI/ANTI join to its left child side

[jira] [Commented] (SPARK-34781) Eliminate LEFT SEMI/ANTI join to its left child side with AQE

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303748#comment-17303748 ] Apache Spark commented on SPARK-34781: -- User 'c21' has created a pull request for this issue:

[jira] [Created] (SPARK-34781) Eliminate LEFT SEMI/ANTI join to its left child side with AQE

2021-03-17 Thread Cheng Su (Jira)
Cheng Su created SPARK-34781: Summary: Eliminate LEFT SEMI/ANTI join to its left child side with AQE Key: SPARK-34781 URL: https://issues.apache.org/jira/browse/SPARK-34781 Project: Spark Issue

[jira] [Commented] (SPARK-34781) Eliminate LEFT SEMI/ANTI join to its left child side with AQE

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303749#comment-17303749 ] Apache Spark commented on SPARK-34781: -- User 'c21' has created a pull request for this issue:

[jira] [Updated] (SPARK-34749) Simplify CreateNamedStruct

2021-03-17 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34749: - Fix Version/s: 3.1.2 > Simplify CreateNamedStruct > -- > >

[jira] [Created] (SPARK-34780) Cached Table (parquet) with old Configs Used

2021-03-17 Thread Michael Chen (Jira)
Michael Chen created SPARK-34780: Summary: Cached Table (parquet) with old Configs Used Key: SPARK-34780 URL: https://issues.apache.org/jira/browse/SPARK-34780 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-34780) Cached Table (parquet) with old Configs Used

2021-03-17 Thread Michael Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Chen updated SPARK-34780: - Description: When a dataframe is cached, the logical plan can contain copies of the spark

[jira] [Resolved] (SPARK-34773) change-scala-version.sh fails to modify pom.xml if it changes the version from 2.13 to 2.12

2021-03-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34773. -- Resolution: Duplicate > change-scala-version.sh fails to modify pom.xml if it changes the

[jira] [Assigned] (SPARK-34708) Code-gen broadcast nested loop join (left semi/left anti)

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34708: Assignee: (was: Apache Spark) > Code-gen broadcast nested loop join (left semi/left

[jira] [Commented] (SPARK-34708) Code-gen broadcast nested loop join (left semi/left anti)

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303772#comment-17303772 ] Apache Spark commented on SPARK-34708: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34708) Code-gen broadcast nested loop join (left semi/left anti)

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34708: Assignee: Apache Spark > Code-gen broadcast nested loop join (left semi/left anti) >

[jira] [Commented] (SPARK-34708) Code-gen broadcast nested loop join (left semi/left anti)

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303773#comment-17303773 ] Apache Spark commented on SPARK-34708: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34784) Upgrade Jackson to 2.12.2

2021-03-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-34784: --- Assignee: (was: Yuming Wang) > Upgrade Jackson to 2.12.2 > - >

[jira] [Assigned] (SPARK-34784) Upgrade Jackson to 2.12.2

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34784: Assignee: (was: Apache Spark) > Upgrade Jackson to 2.12.2 >

[jira] [Updated] (SPARK-34784) Upgrade Jackson to 2.12.2

2021-03-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-34784: Fix Version/s: (was: 3.2.0) > Upgrade Jackson to 2.12.2 > - > >

[jira] [Assigned] (SPARK-34784) Upgrade Jackson to 2.12.2

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34784: Assignee: Apache Spark > Upgrade Jackson to 2.12.2 > - > >

[jira] [Commented] (SPARK-34784) Upgrade Jackson to 2.12.2

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303858#comment-17303858 ] Apache Spark commented on SPARK-34784: -- User 'xclyfe' has created a pull request for this issue:

[jira] [Commented] (SPARK-34784) Upgrade Jackson to 2.12.2

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303860#comment-17303860 ] Apache Spark commented on SPARK-34784: -- User 'xclyfe' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34762) Many PR's Scala 2.13 build action failed

2021-03-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34762: Assignee: Kousuke Saruta > Many PR's Scala 2.13 build action failed >

[jira] [Commented] (SPARK-34783) Support remote template files via spark.jars

2021-03-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303853#comment-17303853 ] Apache Spark commented on SPARK-34783: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-34784) Upgrade Jackson to 2.12.2

2021-03-17 Thread Xingchao, Zhang (Jira)
Xingchao, Zhang created SPARK-34784: --- Summary: Upgrade Jackson to 2.12.2 Key: SPARK-34784 URL: https://issues.apache.org/jira/browse/SPARK-34784 Project: Spark Issue Type: Sub-task

  1   2   >