[jira] [Resolved] (SPARK-24527) select column alias should support quotation marks

[ https://issues.apache.org/jira/browse/SPARK-24527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24527. -- Resolution: Incomplete > select column alias should support quotation marks >

[jira] [Resolved] (SPARK-20869) Master should clear failed apps when worker down

[ https://issues.apache.org/jira/browse/SPARK-20869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-20869. -- Resolution: Incomplete > Master should clear failed apps when worker down > --

[jira] [Resolved] (SPARK-25022) Add spark.executor.pyspark.memory support to Mesos

[ https://issues.apache.org/jira/browse/SPARK-25022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25022. -- Resolution: Incomplete > Add spark.executor.pyspark.memory support to Mesos >

[jira] [Resolved] (SPARK-24835) col function ignores drop

[ https://issues.apache.org/jira/browse/SPARK-24835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24835. -- Resolution: Incomplete > col function ignores drop > - > >

[jira] [Resolved] (SPARK-23607) Use HDFS extended attributes to store application summary to improve the Spark History Server performance

[ https://issues.apache.org/jira/browse/SPARK-23607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23607. -- Resolution: Incomplete > Use HDFS extended attributes to store application summary to improve

[jira] [Resolved] (SPARK-25057) Unable to start spark on master URL

[ https://issues.apache.org/jira/browse/SPARK-25057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25057. -- Resolution: Incomplete > Unable to start spark on master URL > ---

[jira] [Resolved] (SPARK-23653) Show sql statement in spark SQL UI

[ https://issues.apache.org/jira/browse/SPARK-23653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23653. -- Resolution: Incomplete > Show sql statement in spark SQL UI >

[jira] [Resolved] (SPARK-24114) improve instrumentation for spark.ml.recommendation

[ https://issues.apache.org/jira/browse/SPARK-24114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24114. -- Resolution: Incomplete > improve instrumentation for spark.ml.recommendation > ---

[jira] [Resolved] (SPARK-24281) Option to disable Spark UI's web filter in YARN-client mode

[ https://issues.apache.org/jira/browse/SPARK-24281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24281. -- Resolution: Incomplete > Option to disable Spark UI's web filter in YARN-client mode > ---

[jira] [Resolved] (SPARK-24848) When a stage fails onStageCompleted is called before onTaskEnd

[ https://issues.apache.org/jira/browse/SPARK-24848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24848. -- Resolution: Incomplete > When a stage fails onStageCompleted is called before onTaskEnd >

[jira] [Resolved] (SPARK-21024) CSV parse mode handles Univocity parser exceptions

[ https://issues.apache.org/jira/browse/SPARK-21024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21024. -- Resolution: Incomplete > CSV parse mode handles Univocity parser exceptions >

[jira] [Resolved] (SPARK-23910) Publish executor memory utilisation in heartbeat events

[ https://issues.apache.org/jira/browse/SPARK-23910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23910. -- Resolution: Incomplete > Publish executor memory utilisation in heartbeat events > ---

[jira] [Resolved] (SPARK-21199) Its not possible to impute Vector types

[ https://issues.apache.org/jira/browse/SPARK-21199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21199. -- Resolution: Incomplete > Its not possible to impute Vector types > ---

[jira] [Resolved] (SPARK-24832) Improve inputMetrics's bytesRead update for ColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-24832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24832. -- Resolution: Incomplete > Improve inputMetrics's bytesRead update for ColumnarBatch > -

[jira] [Resolved] (SPARK-24738) [HistoryServer] FsHistoryProvider clean outdated event logs at start

[ https://issues.apache.org/jira/browse/SPARK-24738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24738. -- Resolution: Incomplete > [HistoryServer] FsHistoryProvider clean outdated event logs at start

[jira] [Resolved] (SPARK-21071) make WritableColumnVector public

[ https://issues.apache.org/jira/browse/SPARK-21071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21071. -- Resolution: Incomplete > make WritableColumnVector public > >

[jira] [Resolved] (SPARK-25563) Spark application hangs If container allocate on lost Nodemanager

[ https://issues.apache.org/jira/browse/SPARK-25563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25563. -- Resolution: Incomplete > Spark application hangs If container allocate on lost Nodemanager > -

[jira] [Resolved] (SPARK-25334) Default SessionCatalog should support UDFs

[ https://issues.apache.org/jira/browse/SPARK-25334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25334. -- Resolution: Incomplete > Default SessionCatalog should support UDFs >

[jira] [Resolved] (SPARK-24245) Flaky test: KafkaContinuousSinkSuite

[ https://issues.apache.org/jira/browse/SPARK-24245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24245. -- Resolution: Incomplete > Flaky test: KafkaContinuousSinkSuite > --

[jira] [Resolved] (SPARK-19250) In security cluster, spark beeline connect to hive metastore failed

[ https://issues.apache.org/jira/browse/SPARK-19250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-19250. -- Resolution: Incomplete > In security cluster, spark beeline connect to hive metastore failed >

[jira] [Resolved] (SPARK-24025) Join of bucketed and non-bucketed tables can give two exchanges and sorts for non-bucketed side

[ https://issues.apache.org/jira/browse/SPARK-24025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24025. -- Resolution: Incomplete > Join of bucketed and non-bucketed tables can give two exchanges and s

[jira] [Resolved] (SPARK-24619) DOCO - usage of authenticate.secret between masters/workers not clear

[ https://issues.apache.org/jira/browse/SPARK-24619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24619. -- Resolution: Incomplete > DOCO - usage of authenticate.secret between masters/workers not clear

[jira] [Resolved] (SPARK-23328) Disallow default value None in na.replace/replace when 'to_replace' is not a dictionary

[ https://issues.apache.org/jira/browse/SPARK-23328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23328. -- Resolution: Incomplete > Disallow default value None in na.replace/replace when 'to_replace' i

[jira] [Resolved] (SPARK-24515) No need to warning user when output commit coordination enabled

[ https://issues.apache.org/jira/browse/SPARK-24515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24515. -- Resolution: Incomplete > No need to warning user when output commit coordination enabled > ---

[jira] [Resolved] (SPARK-25087) update/port all builds to run on ubuntu 16.04 LTS

[ https://issues.apache.org/jira/browse/SPARK-25087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25087. -- Resolution: Incomplete > update/port all builds to run on ubuntu 16.04 LTS > -

[jira] [Resolved] (SPARK-25467) Python date/datetime objects in dataframes increment by 1 day when converted to JSON

[ https://issues.apache.org/jira/browse/SPARK-25467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25467. -- Resolution: Incomplete > Python date/datetime objects in dataframes increment by 1 day when co

[jira] [Resolved] (SPARK-20625) SQL test running on Windows hadoop command warning

[ https://issues.apache.org/jira/browse/SPARK-20625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-20625. -- Resolution: Incomplete > SQL test running on Windows hadoop command warning >

[jira] [Resolved] (SPARK-24425) Regression from 1.6 to 2.x - Spark no longer respects input partitions, unnecessary shuffle required

[ https://issues.apache.org/jira/browse/SPARK-24425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24425. -- Resolution: Incomplete > Regression from 1.6 to 2.x - Spark no longer respects input partition

[jira] [Resolved] (SPARK-23507) Migrate file-based data sources to data source v2

[ https://issues.apache.org/jira/browse/SPARK-23507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23507. -- Resolution: Incomplete > Migrate file-based data sources to data source v2 > -

[jira] [Resolved] (SPARK-22031) KMeans - Compute cost for a single vector

[ https://issues.apache.org/jira/browse/SPARK-22031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22031. -- Resolution: Incomplete > KMeans - Compute cost for a single vector > -

[jira] [Resolved] (SPARK-18388) Running aggregation on many columns throws SOE

[ https://issues.apache.org/jira/browse/SPARK-18388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-18388. -- Resolution: Incomplete > Running aggregation on many columns throws SOE >

[jira] [Resolved] (SPARK-24702) Unable to cast to calendar interval in spark sql.

[ https://issues.apache.org/jira/browse/SPARK-24702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24702. -- Resolution: Incomplete > Unable to cast to calendar interval in spark sql. > -

[jira] [Resolved] (SPARK-23800) Support partial function and callable object with pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-23800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23800. -- Resolution: Incomplete > Support partial function and callable object with pandas UDF > --

[jira] [Resolved] (SPARK-23813) [SparkSQL] the result is different between hive and spark when use PARSE_URL()

[ https://issues.apache.org/jira/browse/SPARK-23813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23813. -- Resolution: Incomplete > [SparkSQL] the result is different between hive and spark when use >

[jira] [Resolved] (SPARK-24843) Spark2 job (in cluster mode) is unable to execute steps in HBase (error# java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/CompatibilityFactory)

[ https://issues.apache.org/jira/browse/SPARK-24843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24843. -- Resolution: Incomplete > Spark2 job (in cluster mode) is unable to execute steps in HBase (err

[jira] [Updated] (SPARK-25475) Refactor all benchmark to save the result as a separate file

[ https://issues.apache.org/jira/browse/SPARK-25475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25475: -- Fix Version/s: 3.0.0 > Refactor all benchmark to save the result as a separate file >

[jira] [Comment Edited] (SPARK-25475) Refactor all benchmark to save the result as a separate file

[ https://issues.apache.org/jira/browse/SPARK-25475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946477#comment-16946477 ] Dongjoon Hyun edited comment on SPARK-25475 at 10/8/19 4:37 AM: --

[jira] [Commented] (SPARK-25475) Refactor all benchmark to save the result as a separate file

[ https://issues.apache.org/jira/browse/SPARK-25475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946477#comment-16946477 ] Dongjoon Hyun commented on SPARK-25475: --- Hi, All. Thank you for all your guide and

[jira] [Assigned] (SPARK-25475) Refactor all benchmark to save the result as a separate file

[ https://issues.apache.org/jira/browse/SPARK-25475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25475: - Assignee: Yuming Wang > Refactor all benchmark to save the result as a separate file >

[jira] [Resolved] (SPARK-25668) Refactor TPCDSQueryBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25668. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26049 [https://gi

[jira] [Resolved] (SPARK-25475) Refactor all benchmark to save the result as a separate file

[ https://issues.apache.org/jira/browse/SPARK-25475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25475. -- Resolution: Done > Refactor all benchmark to save the result as a separate file >

[jira] [Created] (SPARK-29378) Make AppVeyor's SparkR with Arrow tests compatible with Arrow R 0.15

Hyukjin Kwon created SPARK-29378: Summary: Make AppVeyor's SparkR with Arrow tests compatible with Arrow R 0.15 Key: SPARK-29378 URL: https://issues.apache.org/jira/browse/SPARK-29378 Project: Spark

[jira] [Commented] (SPARK-29286) UnicodeDecodeError raised when running python tests on arm instance

[ https://issues.apache.org/jira/browse/SPARK-29286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946422#comment-16946422 ] huangtianhua commented on SPARK-29286: -- Thanks all. I will test this on arm instanc

[jira] [Updated] (SPARK-29224) Implement Factorization Machines as a ml-pipeline component

[ https://issues.apache.org/jira/browse/SPARK-29224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mob-ai updated SPARK-29224: --- Affects Version/s: (was: 3.0.0) 2.4.3 > Implement Factorization Machines as a ml-

[jira] [Updated] (SPARK-29224) Implement Factorization Machines as a ml-pipeline component

[ https://issues.apache.org/jira/browse/SPARK-29224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mob-ai updated SPARK-29224: --- Affects Version/s: (was: 2.4.3) 3.0.0 > Implement Factorization Machines as a ml-

[jira] [Commented] (SPARK-29377) parity between scala ml tuning and python ml tuning

[ https://issues.apache.org/jira/browse/SPARK-29377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946352#comment-16946352 ] Huaxin Gao commented on SPARK-29377: I will submit a PR soon. > parity between sca

[jira] [Created] (SPARK-29377) parity between scala ml tuning and python ml tuning

Huaxin Gao created SPARK-29377: -- Summary: parity between scala ml tuning and python ml tuning Key: SPARK-29377 URL: https://issues.apache.org/jira/browse/SPARK-29377 Project: Spark Issue Type: S

[jira] [Assigned] (SPARK-25668) Refactor TPCDSQueryBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25668: - Assignee: Dongjoon Hyun > Refactor TPCDSQueryBenchmark to use main method > ---

[jira] [Commented] (SPARK-25668) Refactor TPCDSQueryBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946343#comment-16946343 ] Dongjoon Hyun commented on SPARK-25668: --- I'll make a PR soon. > Refactor TPCDSQue

[jira] [Assigned] (SPARK-11215) Add multiple columns support to StringIndexer

[ https://issues.apache.org/jira/browse/SPARK-11215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-11215: --- Assignee: L. C. Hsieh (was: Yanbo Liang) > Add multiple columns support to StringIndexer >

[jira] [Resolved] (SPARK-25667) Refactor SynthBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25667. --- Resolution: Won't Do Hi, [~yumwang] and [~cloud_fan]. I'll close this issue as `Won't Do` be

[jira] [Commented] (SPARK-28938) Move to supported OpenJDK docker image for Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946275#comment-16946275 ] Dongjoon Hyun commented on SPARK-28938: --- Since `branch-2.4` is our LTS branch, thi

[jira] [Updated] (SPARK-28938) Move to supported OpenJDK docker image for Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28938: -- Summary: Move to supported OpenJDK docker image for Kubernetes (was: Kubernetes using unsuppo

[jira] [Updated] (SPARK-28938) Kubernetes using unsupported docker image

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28938: -- Affects Version/s: 2.4.4 > Kubernetes using unsupported docker image > ---

[jira] [Updated] (SPARK-28938) Kubernetes using unsupported docker image

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28938: -- Fix Version/s: 2.4.5 > Kubernetes using unsupported docker image > ---

[jira] [Commented] (SPARK-29367) pandas udf not working with latest pyarrow release (0.15.0)

[ https://issues.apache.org/jira/browse/SPARK-29367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946266#comment-16946266 ] Julien Peloton commented on SPARK-29367: Thanks, it works like a charm! Julien

[jira] [Commented] (SPARK-28938) Kubernetes using unsupported docker image

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946261#comment-16946261 ] Dongjoon Hyun commented on SPARK-28938: --- [~AceHack]. That is completely different

[jira] [Resolved] (SPARK-26217) Compliance to SQL standard (SQL:2011)

[ https://issues.apache.org/jira/browse/SPARK-26217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang resolved SPARK-26217. -- Resolution: Duplicate This issue is part of SPARK-27764, I'll move all the sub-tasks and mark

[jira] [Updated] (SPARK-27149) Support LOCALTIMESTAMP when ANSI mode enabled

[ https://issues.apache.org/jira/browse/SPARK-27149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-27149: - Parent: SPARK-27764 (was: SPARK-26217) > Support LOCALTIMESTAMP when ANSI mode enabled > --

[jira] [Updated] (SPARK-27148) Support CURRENT_TIME and LOCALTIME when ANSI mode enabled

[ https://issues.apache.org/jira/browse/SPARK-27148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-27148: - Parent: SPARK-27764 (was: SPARK-26217) > Support CURRENT_TIME and LOCALTIME when ANSI mode enab

[jira] [Updated] (SPARK-29096) The exact math method should be called only when there is a corresponding function in Math

[ https://issues.apache.org/jira/browse/SPARK-29096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-29096: - Parent: SPARK-27764 (was: SPARK-26217) > The exact math method should be called only when there

[jira] [Updated] (SPARK-26215) define reserved keywords after SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-26215: - Parent: SPARK-27764 (was: SPARK-26217) > define reserved keywords after SQL standard >

[jira] [Updated] (SPARK-26218) Throw exception on overflow for integers

[ https://issues.apache.org/jira/browse/SPARK-26218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-26218: - Parent: SPARK-27764 (was: SPARK-26217) > Throw exception on overflow for integers > ---

[jira] [Updated] (SPARK-23179) Support option to throw exception if overflow occurs during Decimal arithmetic

[ https://issues.apache.org/jira/browse/SPARK-23179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-23179: - Parent: SPARK-27764 (was: SPARK-26217) > Support option to throw exception if overflow occurs d

[jira] [Updated] (SPARK-26976) Forbid reserved keywords as identifiers when ANSI mode is on

[ https://issues.apache.org/jira/browse/SPARK-26976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-26976: - Parent: SPARK-27764 (was: SPARK-26217) > Forbid reserved keywords as identifiers when ANSI mode

[jira] [Updated] (SPARK-23264) Support interval values without INTERVAL clauses

[ https://issues.apache.org/jira/browse/SPARK-23264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang updated SPARK-23264: - Parent: SPARK-27764 (was: SPARK-26217) > Support interval values without INTERVAL clauses > ---

[jira] [Resolved] (SPARK-27468) "Storage Level" in "RDD Storage Page" is not correct

[ https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-27468. -- Fix Version/s: 3.0.0 Resolution: Fixed Resolved by https://github.com/apache/spark/pull

[jira] [Assigned] (SPARK-27468) "Storage Level" in "RDD Storage Page" is not correct

[ https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-27468: Assignee: Marcelo Masiero Vanzin > "Storage Level" in "RDD Storage Page" is not correct >

[jira] [Commented] (SPARK-29336) The implementation of QuantileSummaries.merge does not guarantee that the relativeError will be respected

[ https://issues.apache.org/jira/browse/SPARK-29336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946187#comment-16946187 ] L. C. Hsieh commented on SPARK-29336: - Actually I found the merging is changed by ot

[jira] [Commented] (SPARK-29189) Add an option to ignore block locations when listing file

[ https://issues.apache.org/jira/browse/SPARK-29189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946176#comment-16946176 ] Imran Rashid commented on SPARK-29189: -- Fixed by pr https://github.com/apache/spark

[jira] [Assigned] (SPARK-29189) Add an option to ignore block locations when listing file

[ https://issues.apache.org/jira/browse/SPARK-29189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-29189: Assignee: Wang, Gang > Add an option to ignore block locations when listing file > --

[jira] [Resolved] (SPARK-29189) Add an option to ignore block locations when listing file

[ https://issues.apache.org/jira/browse/SPARK-29189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-29189. -- Fix Version/s: 3.0.0 Resolution: Fixed > Add an option to ignore block locations when l

[jira] [Commented] (SPARK-29325) approxQuantile() results are incorrect and vary significantly for small changes in relativeError

[ https://issues.apache.org/jira/browse/SPARK-29325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946166#comment-16946166 ] Frank Astier commented on SPARK-29325: -- I noticed that the algorithm is sensitive t

[jira] [Commented] (SPARK-28938) Kubernetes using unsupported docker image

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946153#comment-16946153 ] Rodney Aaron Stainback commented on SPARK-28938: Any chance of updating

[jira] [Resolved] (SPARK-29208) Document LIST FILE in SQL Reference

[ https://issues.apache.org/jira/browse/SPARK-29208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-29208. Resolution: Fixed This is done along with ADD JAR in https://issues.apache.org/jira/browse/SPARK-

[jira] [Resolved] (SPARK-29207) Document LIST JAR in SQL Reference

[ https://issues.apache.org/jira/browse/SPARK-29207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-29207. Resolution: Fixed > Document LIST JAR in SQL Reference > -- > >

[jira] [Commented] (SPARK-29207) Document LIST JAR in SQL Reference

[ https://issues.apache.org/jira/browse/SPARK-29207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946142#comment-16946142 ] Huaxin Gao commented on SPARK-29207: This is done along with ADD JAR in https://iss

[jira] [Resolved] (SPARK-28815) Document ADD FILE statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-28815. Resolution: Fixed > Document ADD FILE statement in SQL Reference. > --

[jira] [Commented] (SPARK-28815) Document ADD FILE statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946141#comment-16946141 ] Huaxin Gao commented on SPARK-28815: This is done along with ADD JAR in https://iss

[jira] [Comment Edited] (SPARK-22390) Aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-22390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946140#comment-16946140 ] Huaxin Gao edited comment on SPARK-22390 at 10/7/19 6:54 PM: -

[jira] [Commented] (SPARK-22390) Aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-22390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946140#comment-16946140 ] Huaxin Gao commented on SPARK-22390: I am slowly catching up the changes in Data Sou

[jira] [Created] (SPARK-29376) Upgrade Apache Arrow to 0.15.0

Bryan Cutler created SPARK-29376: Summary: Upgrade Apache Arrow to 0.15.0 Key: SPARK-29376 URL: https://issues.apache.org/jira/browse/SPARK-29376 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-28816) Document ADD JAR statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-28816: - Priority: Minor (was: Major) > Document ADD JAR statement in SQL Reference. > -

[jira] [Assigned] (SPARK-28816) Document ADD JAR statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-28816: Assignee: Huaxin Gao > Document ADD JAR statement in SQL Reference. > ---

[jira] [Resolved] (SPARK-28816) Document ADD JAR statement in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-28816. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25895 [https://gi

[jira] [Commented] (SPARK-29367) pandas udf not working with latest pyarrow release (0.15.0)

[ https://issues.apache.org/jira/browse/SPARK-29367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946093#comment-16946093 ] Bryan Cutler commented on SPARK-29367: -- There was a change in the Arrow IPC format,

[jira] [Assigned] (SPARK-29367) pandas udf not working with latest pyarrow release (0.15.0)

[ https://issues.apache.org/jira/browse/SPARK-29367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned SPARK-29367: Assignee: Bryan Cutler > pandas udf not working with latest pyarrow release (0.15.0) > --

[jira] [Updated] (SPARK-29367) pandas udf not working with latest pyarrow release (0.15.0)

[ https://issues.apache.org/jira/browse/SPARK-29367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-29367: - Issue Type: Documentation (was: Bug) > pandas udf not working with latest pyarrow release (0.15

[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946069#comment-16946069 ] Mukul Murthy commented on SPARK-29358: -- I agree that it should not change the curre

[jira] [Created] (SPARK-29375) Exchange reuse across all subquery levels

Peter Toth created SPARK-29375: -- Summary: Exchange reuse across all subquery levels Key: SPARK-29375 URL: https://issues.apache.org/jira/browse/SPARK-29375 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-28938) Kubernetes using unsupported docker image

[ https://issues.apache.org/jira/browse/SPARK-28938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946062#comment-16946062 ] Dongjoon Hyun commented on SPARK-28938: --- [~AceHack]. That's the reason why I think

[jira] [Created] (SPARK-29374) do not allow arbitrary v2 catalog as session catalog

Wenchen Fan created SPARK-29374: --- Summary: do not allow arbitrary v2 catalog as session catalog Key: SPARK-29374 URL: https://issues.apache.org/jira/browse/SPARK-29374 Project: Spark Issue Type

[jira] [Commented] (SPARK-29372) Codegen grows beyond 64 KB for more columns in case of SupportsScanColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-29372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946036#comment-16946036 ] Andrew Malone Melo commented on SPARK-29372: Coincidentally enough, I just l

[jira] [Created] (SPARK-29373) DataSourceV2: Commands should not submit a spark job.

Terry Kim created SPARK-29373: - Summary: DataSourceV2: Commands should not submit a spark job. Key: SPARK-29373 URL: https://issues.apache.org/jira/browse/SPARK-29373 Project: Spark Issue Type: B

[jira] [Assigned] (SPARK-29342) Make casting strings to intervals case insensitive

[ https://issues.apache.org/jira/browse/SPARK-29342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29342: - Assignee: Maxim Gekk > Make casting strings to intervals case insensitive > --

[jira] [Resolved] (SPARK-29342) Make casting strings to intervals case insensitive

[ https://issues.apache.org/jira/browse/SPARK-29342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29342. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26010 [https://

[jira] [Commented] (SPARK-29336) The implementation of QuantileSummaries.merge does not guarantee that the relativeError will be respected

[ https://issues.apache.org/jira/browse/SPARK-29336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16945985#comment-16945985 ] L. C. Hsieh commented on SPARK-29336: - It is long time ago, but from the comment see

[jira] [Updated] (SPARK-29372) Codegen grows beyond 64 KB for more columns in case of SupportsScanColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-29372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shubham Chaurasia updated SPARK-29372: -- Description: In case of vectorized DSv2 readers i.e. if it implements {{SupportsScanC

[jira] [Assigned] (SPARK-29143) Pyspark feature models support column setters/getters

[ https://issues.apache.org/jira/browse/SPARK-29143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-29143: Assignee: Huaxin Gao > Pyspark feature models support column setters/getters > --

[jira] [Resolved] (SPARK-29143) Pyspark feature models support column setters/getters

[ https://issues.apache.org/jira/browse/SPARK-29143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29143. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25908 [https://gi

<    1   2   3   4   5   6   >