[jira] [Resolved] (SPARK-31515) Canonicalize Cast should consider the value of needTimeZone

[ https://issues.apache.org/jira/browse/SPARK-31515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31515. -- Fix Version/s: 3.0.0 Assignee: Yuanjian Li Resolution: Fixed Resolved

[jira] [Resolved] (SPARK-31465) Document Literal in SQL Reference

[ https://issues.apache.org/jira/browse/SPARK-31465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31465. -- Fix Version/s: 3.0.0 Assignee: Huaxin Gao Resolution: Fixed Resolved

[jira] [Commented] (SPARK-29185) Add new SaveMode types for Spark SQL jdbc datasource

[ https://issues.apache.org/jira/browse/SPARK-29185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090252#comment-17090252 ] Shashanka Balakuntala Srinivasa commented on SPARK-29185: - Hi, is there anyone

[jira] [Resolved] (SPARK-31508) string type compare with numberic cause data inaccurate

[ https://issues.apache.org/jira/browse/SPARK-31508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31508. -- Resolution: Duplicate > string type compare with numberic cause data inaccurate >

[jira] [Created] (SPARK-31525) Inconsistent result of df.head(1) and df.head()

Joshua Hendinata created SPARK-31525: Summary: Inconsistent result of df.head(1) and df.head() Key: SPARK-31525 URL: https://issues.apache.org/jira/browse/SPARK-31525 Project: Spark

[jira] [Updated] (SPARK-31518) Expose filterByRange in JavaPairRDD

[ https://issues.apache.org/jira/browse/SPARK-31518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31518: -- Labels: (was: patch) > Expose filterByRange in JavaPairRDD >

[jira] [Updated] (SPARK-31518) Expose filterByRange in JavaPairRDD

[ https://issues.apache.org/jira/browse/SPARK-31518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31518: -- Affects Version/s: (was: 2.4.5) 3.1.0 > Expose filterByRange in

[jira] [Resolved] (SPARK-31518) Expose filterByRange in JavaPairRDD

[ https://issues.apache.org/jira/browse/SPARK-31518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31518. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28293

[jira] [Assigned] (SPARK-31518) Expose filterByRange in JavaPairRDD

[ https://issues.apache.org/jira/browse/SPARK-31518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31518: - Assignee: Antonin Delpeuch > Expose filterByRange in JavaPairRDD >

[jira] [Updated] (SPARK-31523) LogicalPlan doCanonicalize should throw exception if not resolved

[ https://issues.apache.org/jira/browse/SPARK-31523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-31523: Summary: LogicalPlan doCanonicalize should throw exception if not resolved (was: LogicalPlan

[jira] [Updated] (SPARK-31523) LogicalPlan doCanonicalize should throw exception if expression is not resolved

[ https://issues.apache.org/jira/browse/SPARK-31523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-31523: Summary: LogicalPlan doCanonicalize should throw exception if expression is not resolved (was:

[jira] [Created] (SPARK-31524) Add metric to the split number for skew partition when enable AQE

Ke Jia created SPARK-31524: -- Summary: Add metric to the split number for skew partition when enable AQE Key: SPARK-31524 URL: https://issues.apache.org/jira/browse/SPARK-31524 Project: Spark

[jira] [Updated] (SPARK-31523) QueryPlan doCanonicalize should throw exception if expression is not resolved

[ https://issues.apache.org/jira/browse/SPARK-31523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-31523: Summary: QueryPlan doCanonicalize should throw exception if expression is not resolved (was:

[jira] [Created] (SPARK-31523) QueryPlan doCanonicalize should throw exception when expression is not resolved

ulysses you created SPARK-31523: --- Summary: QueryPlan doCanonicalize should throw exception when expression is not resolved Key: SPARK-31523 URL: https://issues.apache.org/jira/browse/SPARK-31523

[jira] [Assigned] (SPARK-29641) Stage Level Sched: Add python api's and test

[ https://issues.apache.org/jira/browse/SPARK-29641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-29641: Assignee: Thomas Graves > Stage Level Sched: Add python api's and test >

[jira] [Resolved] (SPARK-29641) Stage Level Sched: Add python api's and test

[ https://issues.apache.org/jira/browse/SPARK-29641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29641. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28085

[jira] [Resolved] (SPARK-31272) Support DB2 Kerberos login in JDBC connector

[ https://issues.apache.org/jira/browse/SPARK-31272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-31272. Fix Version/s: 3.1.0 Assignee: Gabor Somogyi Resolution:

[jira] [Comment Edited] (SPARK-10925) Exception when joining DataFrames

[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088714#comment-17088714 ] Kushal Yellam edited comment on SPARK-10925 at 4/22/20, 7:21 PM: - Hi

[jira] [Comment Edited] (SPARK-10925) Exception when joining DataFrames

[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088714#comment-17088714 ] Kushal Yellam edited comment on SPARK-10925 at 4/22/20, 7:21 PM: - Hi

[jira] [Comment Edited] (SPARK-10925) Exception when joining DataFrames

[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088714#comment-17088714 ] Kushal Yellam edited comment on SPARK-10925 at 4/22/20, 7:20 PM: - Hi

[jira] [Comment Edited] (SPARK-10925) Exception when joining DataFrames

[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088714#comment-17088714 ] Kushal Yellam edited comment on SPARK-10925 at 4/22/20, 7:17 PM: - Hi

[jira] [Commented] (SPARK-27623) Provider org.apache.spark.sql.avro.AvroFileFormat could not be instantiated

[ https://issues.apache.org/jira/browse/SPARK-27623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089917#comment-17089917 ] Nicholas Chammas commented on SPARK-27623: -- Is this perhaps just a documentation issue? i.e.

[jira] [Updated] (SPARK-31522) Hive metastore client initialization related configurations should be static

[ https://issues.apache.org/jira/browse/SPARK-31522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-31522: - Summary: Hive metastore client initialization related configurations should be static (was: Make

[jira] [Updated] (SPARK-31503) fix the SQL string of the TRIM functions

[ https://issues.apache.org/jira/browse/SPARK-31503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31503: -- Affects Version/s: 2.3.4 2.4.5 > fix the SQL string of the TRIM

[jira] [Commented] (SPARK-31503) fix the SQL string of the TRIM functions

[ https://issues.apache.org/jira/browse/SPARK-31503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089850#comment-17089850 ] Dongjoon Hyun commented on SPARK-31503: --- This is backported to branch-2.4 via

[jira] [Updated] (SPARK-31503) fix the SQL string of the TRIM functions

[ https://issues.apache.org/jira/browse/SPARK-31503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31503: -- Fix Version/s: 2.4.6 > fix the SQL string of the TRIM functions >

[jira] [Resolved] (SPARK-31512) make window function using order by optional

[ https://issues.apache.org/jira/browse/SPARK-31512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31512. -- Resolution: Duplicate > make window function using order by optional >

[jira] [Updated] (SPARK-31522) Make immutable configs in HiveUtils static

[ https://issues.apache.org/jira/browse/SPARK-31522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-31522: - Affects Version/s: 3.0.0 2.0.2 2.1.3

[jira] [Created] (SPARK-31522) Make immutable configs in HiveUtils static

Kent Yao created SPARK-31522: Summary: Make immutable configs in HiveUtils static Key: SPARK-31522 URL: https://issues.apache.org/jira/browse/SPARK-31522 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-31521) The fetch size is not correct when merging blocks into a merged block

wuyi created SPARK-31521: Summary: The fetch size is not correct when merging blocks into a merged block Key: SPARK-31521 URL: https://issues.apache.org/jira/browse/SPARK-31521 Project: Spark Issue

[jira] [Comment Edited] (SPARK-28367) Kafka connector infinite wait because metadata never updated

[ https://issues.apache.org/jira/browse/SPARK-28367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088514#comment-17088514 ] Gabor Somogyi edited comment on SPARK-28367 at 4/22/20, 1:35 PM: - I've

[jira] [Commented] (SPARK-31508) string type compare with numberic cause data inaccurate

[ https://issues.apache.org/jira/browse/SPARK-31508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089663#comment-17089663 ] philipse commented on SPARK-31508: -- haha ,but normall it will be a little complex,we will migrate many

[jira] [Resolved] (SPARK-31495) Support formatted explain for Adaptive Query Execution

[ https://issues.apache.org/jira/browse/SPARK-31495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31495. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28271

[jira] [Assigned] (SPARK-31495) Support formatted explain for Adaptive Query Execution

[ https://issues.apache.org/jira/browse/SPARK-31495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31495: --- Assignee: wuyi > Support formatted explain for Adaptive Query Execution >

[jira] [Commented] (SPARK-12312) JDBC connection to Kerberos secured databases fails on remote executors

[ https://issues.apache.org/jira/browse/SPARK-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089617#comment-17089617 ] Gabor Somogyi commented on SPARK-12312: --- Soon the MS SQL and Oracle server is coming which is not

[jira] [Comment Edited] (SPARK-31508) string type compare with numberic cause data inaccurate

[ https://issues.apache.org/jira/browse/SPARK-31508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089596#comment-17089596 ] JinxinTang edited comment on SPARK-31508 at 4/22/20, 12:00 PM: --- for

[jira] [Created] (SPARK-31520) Add a readiness probe to spark pod definitions

Dale Richardson created SPARK-31520: --- Summary: Add a readiness probe to spark pod definitions Key: SPARK-31520 URL: https://issues.apache.org/jira/browse/SPARK-31520 Project: Spark Issue

[jira] [Issue Comment Deleted] (SPARK-31508) string type compare with numberic cause data inaccurate

[ https://issues.apache.org/jira/browse/SPARK-31508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JinxinTang updated SPARK-31508: --- Comment: was deleted (was: such '2...' is far larger than long, I think we should not covert to

[jira] [Comment Edited] (SPARK-31508) string type compare with numberic cause data inaccurate

[ https://issues.apache.org/jira/browse/SPARK-31508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089598#comment-17089598 ] JinxinTang edited comment on SPARK-31508 at 4/22/20, 11:49 AM: --- such

[jira] [Commented] (SPARK-31508) string type compare with numberic cause data inaccurate

[ https://issues.apache.org/jira/browse/SPARK-31508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089598#comment-17089598 ] JinxinTang commented on SPARK-31508: such '2...' is far larger than big, I think we should not

[jira] [Commented] (SPARK-31508) string type compare with numberic cause data inaccurate

[ https://issues.apache.org/jira/browse/SPARK-31508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089596#comment-17089596 ] JinxinTang commented on SPARK-31508: for example： select * from default.test1 where id > 3D add

[jira] [Commented] (SPARK-31508) string type compare with numberic cause data inaccurate

[ https://issues.apache.org/jira/browse/SPARK-31508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089583#comment-17089583 ] JinxinTang commented on SPARK-31508: You are right,We can see from code gen in branch 2.4 which will

[jira] [Issue Comment Deleted] (SPARK-31508) string type compare with numberic cause data inaccurate

[ https://issues.apache.org/jira/browse/SPARK-31508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JinxinTang updated SPARK-31508: --- Comment: was deleted (was: You are right,We can see from code gen in branch 2.4 which will convet

[jira] [Assigned] (SPARK-31507) Remove millennium, century, decade, millisecond, microsecond and epoch from extract fucntion

[ https://issues.apache.org/jira/browse/SPARK-31507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31507: --- Assignee: Kent Yao > Remove millennium, century, decade, millisecond, microsecond and

[jira] [Resolved] (SPARK-31507) Remove millennium, century, decade, millisecond, microsecond and epoch from extract fucntion

[ https://issues.apache.org/jira/browse/SPARK-31507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31507. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28284

[jira] [Resolved] (SPARK-31498) Dump public static sql configurations through doc generation

[ https://issues.apache.org/jira/browse/SPARK-31498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31498. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28274

[jira] [Assigned] (SPARK-31498) Dump public static sql configurations through doc generation

[ https://issues.apache.org/jira/browse/SPARK-31498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31498: --- Assignee: Kent Yao > Dump public static sql configurations through doc generation >

[jira] [Resolved] (SPARK-30467) On Federal Information Processing Standard (FIPS) enabled cluster, Spark Workers are not able to connect to Remote Master.

[ https://issues.apache.org/jira/browse/SPARK-30467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-30467. - Resolution: Cannot Reproduce > On Federal Information Processing Standard (FIPS)

[jira] [Commented] (SPARK-30467) On Federal Information Processing Standard (FIPS) enabled cluster, Spark Workers are not able to connect to Remote Master.

[ https://issues.apache.org/jira/browse/SPARK-30467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089517#comment-17089517 ] Prashant Sharma commented on SPARK-30467: - As it is already mentioned here, this is not a SPARK

[jira] [Created] (SPARK-31519) Cast in having aggregate expressions returns the wrong result

Yuanjian Li created SPARK-31519: --- Summary: Cast in having aggregate expressions returns the wrong result Key: SPARK-31519 URL: https://issues.apache.org/jira/browse/SPARK-31519 Project: Spark

[jira] [Commented] (SPARK-31518) Expose filterByRange in JavaPairRDD

[ https://issues.apache.org/jira/browse/SPARK-31518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089514#comment-17089514 ] Antonin Delpeuch commented on SPARK-31518: -- Corresponding pull request:

[jira] [Updated] (SPARK-31516) Non-existed metric hiveClientCalls.count of CodeGenerator in Monitoring Doc

[ https://issues.apache.org/jira/browse/SPARK-31516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZHANG Wei updated SPARK-31516: -- External issue URL: (was: https://github.com/apache/spark/pull/28292) > Non-existed metric

[jira] [Updated] (SPARK-31516) Non-existed metric hiveClientCalls.count of CodeGenerator in Monitoring Doc

[ https://issues.apache.org/jira/browse/SPARK-31516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZHANG Wei updated SPARK-31516: -- External issue URL: https://github.com/apache/spark/pull/28292 > Non-existed metric

[jira] [Updated] (SPARK-31516) Non-existed metric hiveClientCalls.count of CodeGenerator in Monitoring Doc

[ https://issues.apache.org/jira/browse/SPARK-31516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZHANG Wei updated SPARK-31516: -- Description: There is a duplicated `hiveClientCalls.count` metric in both

[jira] [Created] (SPARK-31518) Expose filterByRange in JavaPairRDD

Antonin Delpeuch created SPARK-31518: Summary: Expose filterByRange in JavaPairRDD Key: SPARK-31518 URL: https://issues.apache.org/jira/browse/SPARK-31518 Project: Spark Issue Type:

[jira] [Updated] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ross Bowen updated SPARK-31517: --- Description: When specifying two columns within an `orderBy()` function, to attempt to get an

[jira] [Updated] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ross Bowen updated SPARK-31517: --- Summary: SparkR::orderBy with multiple columns descending produces error (was: orderBy with

[jira] [Updated] (SPARK-31517) orderBy with multiple columns descending does not work properly

[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ross Bowen updated SPARK-31517: --- Description: When specifying two columns within an `orderBy()` function, to attempt to get an

[jira] [Updated] (SPARK-31517) orderBy with multiple columns descending does not work properly

[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ross Bowen updated SPARK-31517: --- Description: When specifying two columns within an `orderBy()` function, to attempt to get an

[jira] [Comment Edited] (SPARK-31508) string type compare with numberic cause data inaccurate

[ https://issues.apache.org/jira/browse/SPARK-31508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089449#comment-17089449 ] JinxinTang edited comment on SPARK-31508 at 4/22/20, 8:33 AM: -- select *

[jira] [Created] (SPARK-31517) orderBy with multiple columns descending does not work properly

Ross Bowen created SPARK-31517: -- Summary: orderBy with multiple columns descending does not work properly Key: SPARK-31517 URL: https://issues.apache.org/jira/browse/SPARK-31517 Project: Spark

[jira] [Commented] (SPARK-31508) string type compare with numberic cause data inaccurate

[ https://issues.apache.org/jira/browse/SPARK-31508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089449#comment-17089449 ] JinxinTang commented on SPARK-31508: select id from test1 where id>'0';  may be seems more normal.

[jira] [Created] (SPARK-31516) Non-existed metric hiveClientCalls.count of CodeGenerator in Monitoring Doc

ZHANG Wei created SPARK-31516: - Summary: Non-existed metric hiveClientCalls.count of CodeGenerator in Monitoring Doc Key: SPARK-31516 URL: https://issues.apache.org/jira/browse/SPARK-31516 Project: Spark

[jira] [Commented] (SPARK-31515) Canonicalize Cast should consider the value of needTimeZone

[ https://issues.apache.org/jira/browse/SPARK-31515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089372#comment-17089372 ] JinxinTang commented on SPARK-31515: Could you please provide code piece or picture to depict this.

[jira] [Commented] (SPARK-31400) The catalogString doesn't distinguish Vectors in ml and mllib

[ https://issues.apache.org/jira/browse/SPARK-31400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089317#comment-17089317 ] JinxinTang commented on SPARK-31400: Thanks for report this issue, this is in progress: