[jira] [Commented] (SPARK-28424) Support typed interval expression

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096158#comment-17096158 ] Apache Spark commented on SPARK-28424: -- User 'xuanyuanking' has created a pull request for this

[jira] [Resolved] (SPARK-31576) Unable to return Hive data into Spark via Hive JDBC driver Caused by: org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED

2020-04-29 Thread liuzhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuzhang resolved SPARK-31576. -- Resolution: Fixed override def quoteIdentifier(colName: String): String = s"$colName" > Unable to

[jira] [Closed] (SPARK-31576) Unable to return Hive data into Spark via Hive JDBC driver Caused by: org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED

2020-04-29 Thread liuzhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuzhang closed SPARK-31576. > Unable to return Hive data into Spark via Hive JDBC driver Caused by: >

[jira] [Created] (SPARK-31614) Unable to write data into hive table using Spark via Hive JDBC driver Caused by: org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED

2020-04-29 Thread liuzhang (Jira)
liuzhang created SPARK-31614: Summary: Unable to write data into hive table using Spark via Hive JDBC driver Caused by: org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED Key: SPARK-31614

[jira] [Assigned] (SPARK-20732) Copy cache data when node is being shut down

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20732: Assignee: Apache Spark (was: Prakhar Jain) > Copy cache data when node is being shut

[jira] [Resolved] (SPARK-31601) Fix spark.kubernetes.executor.podNamePrefix to work

2020-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31601. --- Fix Version/s: 3.0.0 2.4.6 Assignee: Dongjoon Hyun

[jira] [Commented] (SPARK-20732) Copy cache data when node is being shut down

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096138#comment-17096138 ] Apache Spark commented on SPARK-20732: -- User 'prakharjain09' has created a pull request for this

[jira] [Assigned] (SPARK-20732) Copy cache data when node is being shut down

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20732: Assignee: Prakhar Jain (was: Apache Spark) > Copy cache data when node is being shut

[jira] [Created] (SPARK-31613) How can i run spark3.0.0.preview2 version spark on Spark 2.4 CDH cluster?

2020-04-29 Thread Vutukuri Sathvik (Jira)
Vutukuri Sathvik created SPARK-31613: Summary: How can i run spark3.0.0.preview2 version spark on Spark 2.4 CDH cluster? Key: SPARK-31613 URL: https://issues.apache.org/jira/browse/SPARK-31613

[jira] [Commented] (SPARK-31612) SQL Reference clean up

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096124#comment-17096124 ] Apache Spark commented on SPARK-31612: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-31612) SQL Reference clean up

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096122#comment-17096122 ] Apache Spark commented on SPARK-31612: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31612) SQL Reference clean up

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31612: Assignee: (was: Apache Spark) > SQL Reference clean up > -- > >

[jira] [Assigned] (SPARK-31612) SQL Reference clean up

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31612: Assignee: Apache Spark > SQL Reference clean up > -- > >

[jira] [Commented] (SPARK-31557) Legacy parser incorrectly interprets pre-Gregorian dates

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096116#comment-17096116 ] Apache Spark commented on SPARK-31557: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-31612) SQL Reference clean up

2020-04-29 Thread Huaxin Gao (Jira)
Huaxin Gao created SPARK-31612: -- Summary: SQL Reference clean up Key: SPARK-31612 URL: https://issues.apache.org/jira/browse/SPARK-31612 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-31127) Add abstract Selector

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31127: Assignee: (was: Apache Spark) > Add abstract Selector > - > >

[jira] [Assigned] (SPARK-31127) Add abstract Selector

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31127: Assignee: Apache Spark > Add abstract Selector > - > >

[jira] [Resolved] (SPARK-31372) Display expression schema for double checkout alias

2020-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31372. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28194

[jira] [Assigned] (SPARK-31372) Display expression schema for double checkout alias

2020-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31372: --- Assignee: jiaan.geng > Display expression schema for double checkout alias >

[jira] [Assigned] (SPARK-31611) Register NettyMemoryMetrics into Node Manager's metrics system

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31611: Assignee: (was: Apache Spark) > Register NettyMemoryMetrics into Node Manager's

[jira] [Assigned] (SPARK-31611) Register NettyMemoryMetrics into Node Manager's metrics system

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31611: Assignee: Apache Spark > Register NettyMemoryMetrics into Node Manager's metrics system

[jira] [Commented] (SPARK-31611) Register NettyMemoryMetrics into Node Manager's metrics system

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096090#comment-17096090 ] Apache Spark commented on SPARK-31611: -- User 'manuzhang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31595) Spark sql cli should allow unescaped quote mark in quoted string

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31595: Assignee: Apache Spark > Spark sql cli should allow unescaped quote mark in quoted

[jira] [Assigned] (SPARK-31595) Spark sql cli should allow unescaped quote mark in quoted string

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31595: Assignee: (was: Apache Spark) > Spark sql cli should allow unescaped quote mark in

[jira] [Assigned] (SPARK-31608) Add a hybrid KVStore to make UI loading faster

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31608: Assignee: (was: Apache Spark) > Add a hybrid KVStore to make UI loading faster >

[jira] [Assigned] (SPARK-31608) Add a hybrid KVStore to make UI loading faster

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31608: Assignee: Apache Spark > Add a hybrid KVStore to make UI loading faster >

[jira] [Created] (SPARK-31611) Register NettyMemoryMetrics into Node Manager's metrics system

2020-04-29 Thread Manu Zhang (Jira)
Manu Zhang created SPARK-31611: -- Summary: Register NettyMemoryMetrics into Node Manager's metrics system Key: SPARK-31611 URL: https://issues.apache.org/jira/browse/SPARK-31611 Project: Spark

[jira] [Commented] (SPARK-31553) Wrong result of isInCollection for large collections

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096068#comment-17096068 ] Apache Spark commented on SPARK-31553: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31553) Wrong result of isInCollection for large collections

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096067#comment-17096067 ] Apache Spark commented on SPARK-31553: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31449) Investigate the difference between JDK and Spark's time zone offset calculation

2020-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31449: --- Assignee: Maxim Gekk > Investigate the difference between JDK and Spark's time zone offset

[jira] [Assigned] (SPARK-31372) Display expression schema for double checkout alias

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31372: Assignee: Apache Spark > Display expression schema for double checkout alias >

[jira] [Comment Edited] (SPARK-31602) memory leak of JobConf

2020-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096059#comment-17096059 ] Wenchen Fan edited comment on SPARK-31602 at 4/30/20, 3:15 AM: --- The cache

[jira] [Assigned] (SPARK-31372) Display expression schema for double checkout alias

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31372: Assignee: (was: Apache Spark) > Display expression schema for double checkout alias

[jira] [Commented] (SPARK-31030) Backward Compatibility for Parsing and Formatting Datetime

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096060#comment-17096060 ] Apache Spark commented on SPARK-31030: -- User 'gatorsmile' has created a pull request for this

[jira] [Commented] (SPARK-31449) Investigate the difference between JDK and Spark's time zone offset calculation

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096064#comment-17096064 ] Apache Spark commented on SPARK-31449: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Resolved] (SPARK-31449) Investigate the difference between JDK and Spark's time zone offset calculation

2020-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31449. - Fix Version/s: 2.4.6 Resolution: Fixed Issue resolved by pull request 28410

[jira] [Commented] (SPARK-31030) Backward Compatibility for Parsing and Formatting Datetime

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096061#comment-17096061 ] Apache Spark commented on SPARK-31030: -- User 'gatorsmile' has created a pull request for this

[jira] [Commented] (SPARK-31602) memory leak of JobConf

2020-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096059#comment-17096059 ] Wenchen Fan commented on SPARK-31602: - It's a soft-reference map, which should not cause OOM? >

[jira] [Assigned] (SPARK-31601) Fix spark.kubernetes.executor.podNamePrefix to work

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31601: Assignee: (was: Apache Spark) > Fix spark.kubernetes.executor.podNamePrefix to work

[jira] [Assigned] (SPARK-31601) Fix spark.kubernetes.executor.podNamePrefix to work

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31601: Assignee: Apache Spark > Fix spark.kubernetes.executor.podNamePrefix to work >

[jira] [Commented] (SPARK-31601) Fix spark.kubernetes.executor.podNamePrefix to work

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096054#comment-17096054 ] Apache Spark commented on SPARK-31601: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-8981) Set applicationId and appName in log4j MDC

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8981: --- Assignee: (was: Apache Spark) > Set applicationId and appName in log4j MDC >

[jira] [Assigned] (SPARK-8981) Set applicationId and appName in log4j MDC

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8981: --- Assignee: Apache Spark > Set applicationId and appName in log4j MDC >

[jira] [Commented] (SPARK-28070) writeType and writeObject in SparkR should be handled by S3 methods

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096044#comment-17096044 ] Apache Spark commented on SPARK-28070: -- User 'MichaelChirico' has created a pull request for this

[jira] [Commented] (SPARK-28070) writeType and writeObject in SparkR should be handled by S3 methods

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096043#comment-17096043 ] Apache Spark commented on SPARK-28070: -- User 'MichaelChirico' has created a pull request for this

[jira] [Commented] (SPARK-28040) sql() fails to process output of glue::glue_data()

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096042#comment-17096042 ] Apache Spark commented on SPARK-28040: -- User 'MichaelChirico' has created a pull request for this

[jira] [Assigned] (SPARK-31350) Coalesce bucketed tables for join if applicable

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31350: Assignee: (was: Apache Spark) > Coalesce bucketed tables for join if applicable >

[jira] [Assigned] (SPARK-31350) Coalesce bucketed tables for join if applicable

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31350: Assignee: Apache Spark > Coalesce bucketed tables for join if applicable >

[jira] [Commented] (SPARK-31519) Cast in having aggregate expressions returns the wrong result

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096032#comment-17096032 ] Apache Spark commented on SPARK-31519: -- User 'xuanyuanking' has created a pull request for this

[jira] [Commented] (SPARK-30642) LinearSVC blockify input vectors

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096031#comment-17096031 ] Apache Spark commented on SPARK-30642: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-30642) LinearSVC blockify input vectors

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30642: Assignee: zhengruifeng (was: Apache Spark) > LinearSVC blockify input vectors >

[jira] [Assigned] (SPARK-30642) LinearSVC blockify input vectors

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30642: Assignee: Apache Spark (was: zhengruifeng) > LinearSVC blockify input vectors >

[jira] [Commented] (SPARK-30642) LinearSVC blockify input vectors

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096028#comment-17096028 ] Apache Spark commented on SPARK-30642: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-31586) Replace expression TimeSub(l, r) with TimeAdd(l -r)

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096020#comment-17096020 ] Apache Spark commented on SPARK-31586: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-31586) Replace expression TimeSub(l, r) with TimeAdd(l -r)

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096016#comment-17096016 ] Apache Spark commented on SPARK-31586: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-31549) Pyspark SparkContext.cancelJobGroup do not work correctly

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096009#comment-17096009 ] Apache Spark commented on SPARK-31549: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-31549) Pyspark SparkContext.cancelJobGroup do not work correctly

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31549: Assignee: (was: Apache Spark) > Pyspark SparkContext.cancelJobGroup do not work

[jira] [Assigned] (SPARK-31549) Pyspark SparkContext.cancelJobGroup do not work correctly

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31549: Assignee: Apache Spark > Pyspark SparkContext.cancelJobGroup do not work correctly >

[jira] [Commented] (SPARK-31549) Pyspark SparkContext.cancelJobGroup do not work correctly

2020-04-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096008#comment-17096008 ] Apache Spark commented on SPARK-31549: -- User 'WeichenXu123' has created a pull request for this

[jira] [Commented] (SPARK-30132) Scala 2.13 compile errors from Hadoop LocalFileSystem subclasses

2020-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096007#comment-17096007 ] Dongjoon Hyun commented on SPARK-30132: --- Thank you, [~tisue]. > Scala 2.13 compile errors from

[jira] [Resolved] (SPARK-26199) Long expressions cause mutate to fail

2020-04-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26199. -- Resolution: Duplicate > Long expressions cause mutate to fail >

[jira] [Commented] (SPARK-26199) Long expressions cause mutate to fail

2020-04-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096006#comment-17096006 ] Hyukjin Kwon commented on SPARK-26199: -- Thanks, [~michaelchirico] > Long expressions cause mutate

[jira] [Created] (SPARK-31610) Expose hashFunc property in HashingTF

2020-04-29 Thread Weichen Xu (Jira)
Weichen Xu created SPARK-31610: -- Summary: Expose hashFunc property in HashingTF Key: SPARK-31610 URL: https://issues.apache.org/jira/browse/SPARK-31610 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-31566) Add SQL Rest API Documentation

2020-04-29 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095948#comment-17095948 ] Eren Avsarogullari commented on SPARK-31566: Hi Pablo, There is ongoing PR on this: 

[jira] [Commented] (SPARK-30132) Scala 2.13 compile errors from Hadoop LocalFileSystem subclasses

2020-04-29 Thread Seth Tisue (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095936#comment-17095936 ] Seth Tisue commented on SPARK-30132: Scala 2.13.2 is now out. > Scala 2.13 compile errors from

[jira] [Updated] (SPARK-31582) Be able to not populate Hadoop classpath

2020-04-29 Thread DB Tsai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-31582: Fix Version/s: 3.0.0 > Be able to not populate Hadoop classpath >

[jira] [Updated] (SPARK-31582) Being able to not populate Hadoop classpath

2020-04-29 Thread DB Tsai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-31582: Summary: Being able to not populate Hadoop classpath (was: Be able to not populate Hadoop classpath) >

[jira] [Resolved] (SPARK-31582) Be able to not populate Hadoop classpath

2020-04-29 Thread DB Tsai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-31582. - Fix Version/s: 2.4.6 Resolution: Fixed Issue resolved by pull request 28376

[jira] [Assigned] (SPARK-31582) Be able to not populate Hadoop classpath

2020-04-29 Thread DB Tsai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-31582: --- Assignee: DB Tsai > Be able to not populate Hadoop classpath >

[jira] [Commented] (SPARK-31566) Add SQL Rest API Documentation

2020-04-29 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095881#comment-17095881 ] Pablo Langa Blanco commented on SPARK-31566: I'm taking a look on this. I think is useful to

[jira] [Resolved] (SPARK-31604) java.lang.IllegalArgumentException: Frame length should be positive

2020-04-29 Thread Divya Paliwal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divya Paliwal resolved SPARK-31604. --- Resolution: Won't Do > java.lang.IllegalArgumentException: Frame length should be positive

[jira] [Updated] (SPARK-31608) Add a hybrid KVStore to make UI loading faster

2020-04-29 Thread Baohe Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Baohe Zhang updated SPARK-31608: Description: This is a follow-up for the work done by Hieu Huynh in 2019. Add a new class

[jira] [Commented] (SPARK-31609) Add VarianceThresholdSelector to PySpark

2020-04-29 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095749#comment-17095749 ] Huaxin Gao commented on SPARK-31609: https://github.com/apache/spark/pull/28409 > Add

[jira] [Updated] (SPARK-31604) java.lang.IllegalArgumentException: Frame length should be positive

2020-04-29 Thread Divya Paliwal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divya Paliwal updated SPARK-31604: -- Description: Hi, I am currently facing the below error when I run my code to stream data

[jira] [Updated] (SPARK-31604) java.lang.IllegalArgumentException: Frame length should be positive

2020-04-29 Thread Divya Paliwal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divya Paliwal updated SPARK-31604: -- Description: Hi, I am currently facing the below error when I run my code to stream data

[jira] [Created] (SPARK-31609) Add VarianceThresholdSelector to PySpark

2020-04-29 Thread Huaxin Gao (Jira)
Huaxin Gao created SPARK-31609: -- Summary: Add VarianceThresholdSelector to PySpark Key: SPARK-31609 URL: https://issues.apache.org/jira/browse/SPARK-31609 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-31604) java.lang.IllegalArgumentException: Frame length should be positive

2020-04-29 Thread Divya Paliwal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divya Paliwal updated SPARK-31604: -- Description: Hi,  I am currently facing the below error when I run my code to stream data

[jira] [Created] (SPARK-31608) Add a hybrid KVStore to make UI loading faster

2020-04-29 Thread Baohe Zhang (Jira)
Baohe Zhang created SPARK-31608: --- Summary: Add a hybrid KVStore to make UI loading faster Key: SPARK-31608 URL: https://issues.apache.org/jira/browse/SPARK-31608 Project: Spark Issue Type:

[jira] [Updated] (SPARK-31560) Add V1/V2 tests for TextSuite and WholeTextFileSuite

2020-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31560: -- Affects Version/s: (was: 3.0.1) > Add V1/V2 tests for TextSuite and WholeTextFileSuite >

[jira] [Commented] (SPARK-31599) Reading from S3 (Structured Streaming Bucket) Fails after Compaction

2020-04-29 Thread Felix Kizhakkel Jose (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095697#comment-17095697 ] Felix Kizhakkel Jose commented on SPARK-31599: -- Thank you [~gsomogyi]. But this is not a S3

[jira] [Commented] (SPARK-31519) Cast in having aggregate expressions returns the wrong result

2020-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095595#comment-17095595 ] Dongjoon Hyun commented on SPARK-31519: --- For the record, from 2.2.3 ~ 2.4.5, the following queries

[jira] [Updated] (SPARK-31519) Cast in having aggregate expressions returns the wrong result

2020-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31519: -- Affects Version/s: 2.2.3 > Cast in having aggregate expressions returns the wrong result >

[jira] [Updated] (SPARK-31519) Cast in having aggregate expressions returns the wrong result

2020-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31519: -- Priority: Blocker (was: Major) > Cast in having aggregate expressions returns the wrong

[jira] [Updated] (SPARK-31519) Cast in having aggregate expressions returns the wrong result

2020-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31519: -- Affects Version/s: 2.3.4 > Cast in having aggregate expressions returns the wrong result >

[jira] [Updated] (SPARK-31607) fix perf regression in CTESubstitution

2020-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31607: Affects Version/s: (was: 3.0.0) 3.1.0 > fix perf regression in

[jira] [Updated] (SPARK-31607) fix perf regression in CTESubstitution

2020-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31607: Issue Type: Improvement (was: Bug) > fix perf regression in CTESubstitution >

[jira] [Updated] (SPARK-31607) Improve the perf of CTESubstitution

2020-04-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31607: Summary: Improve the perf of CTESubstitution (was: fix perf regression in CTESubstitution) >

[jira] [Commented] (SPARK-31519) Cast in having aggregate expressions returns the wrong result

2020-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095594#comment-17095594 ] Dongjoon Hyun commented on SPARK-31519: --- This is backported to branch-2.4 via

[jira] [Updated] (SPARK-31519) Cast in having aggregate expressions returns the wrong result

2020-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31519: -- Fix Version/s: 2.4.6 > Cast in having aggregate expressions returns the wrong result >

[jira] [Updated] (SPARK-31519) Cast in having aggregate expressions returns the wrong result

2020-04-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31519: -- Affects Version/s: 2.4.5 > Cast in having aggregate expressions returns the wrong result >

[jira] [Updated] (SPARK-31604) java.lang.IllegalArgumentException: Frame length should be positive

2020-04-29 Thread Divya Paliwal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divya Paliwal updated SPARK-31604: -- Description: Hi,  I am currently facing the below error when I run my code to stream data

[jira] [Updated] (SPARK-31604) java.lang.IllegalArgumentException: Frame length should be positive

2020-04-29 Thread Divya Paliwal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divya Paliwal updated SPARK-31604: -- Description: Hi,  I am currently facing the below error when I run my code to stream data

[jira] [Updated] (SPARK-31604) java.lang.IllegalArgumentException: Frame length should be positive

2020-04-29 Thread Divya Paliwal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divya Paliwal updated SPARK-31604: -- Environment: Scala version 2.11.12 Spark version 2.4.4 >

[jira] [Created] (SPARK-31607) fix perf regression in CTESubstitution

2020-04-29 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-31607: --- Summary: fix perf regression in CTESubstitution Key: SPARK-31607 URL: https://issues.apache.org/jira/browse/SPARK-31607 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-31606) reduce the perf regression of vectorized parquet reader caused by datetime rebase

2020-04-29 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-31606: --- Summary: reduce the perf regression of vectorized parquet reader caused by datetime rebase Key: SPARK-31606 URL: https://issues.apache.org/jira/browse/SPARK-31606

[jira] [Updated] (SPARK-31605) Unable to insert data with partial dynamic partition with Spark & Hive 3

2020-04-29 Thread Amit Ashish (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Ashish updated SPARK-31605: Description: When performing inserting data with dynamic partition, the operation fails if all

[jira] [Commented] (SPARK-31605) Unable to insert data with partial dynamic partition with Spark & Hive 3

2020-04-29 Thread Amit Ashish (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095462#comment-17095462 ] Amit Ashish commented on SPARK-31605: - previously closed ticket does not show the actual insert

[jira] [Updated] (SPARK-31605) Unable to insert data with partial dynamic partition with Spark & Hive 3

2020-04-29 Thread Amit Ashish (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Ashish updated SPARK-31605: Description: When performing inserting data with dynamic partition, the operation fails if all

[jira] [Comment Edited] (SPARK-31605) Unable to insert data with partial dynamic partition with Spark & Hive 3

2020-04-29 Thread Amit Ashish (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095462#comment-17095462 ] Amit Ashish edited comment on SPARK-31605 at 4/29/20, 1:42 PM: --- previously

[jira] [Created] (SPARK-31605) Unable to insert data with partial dynamic partition with Spark & Hive 3

2020-04-29 Thread Amit Ashish (Jira)
Amit Ashish created SPARK-31605: --- Summary: Unable to insert data with partial dynamic partition with Spark & Hive 3 Key: SPARK-31605 URL: https://issues.apache.org/jira/browse/SPARK-31605 Project:

  1   2   >