[jira] [Commented] (SPARK-32306) `approx_percentile` in Spark SQL gives incorrect results

2020-09-21 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199839#comment-17199839 ] Maxim Gekk commented on SPARK-32306: The function returns an element of the input se

[jira] [Commented] (SPARK-27345) Expose approx_percentile in python api

2020-09-21 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199618#comment-17199618 ] Maxim Gekk commented on SPARK-27345: The function was exposed recently by https://gi

[jira] [Commented] (SPARK-32306) `approx_percentile` in Spark SQL gives incorrect results

2020-09-21 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199615#comment-17199615 ] Maxim Gekk commented on SPARK-32306: [~seanmalory] Which result do you expect? 8? >

[jira] [Commented] (SPARK-30882) Inaccurate results with higher precision ApproximatePercentile results

2020-09-21 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199602#comment-17199602 ] Maxim Gekk commented on SPARK-30882: This PR [https://github.com/apache/spark/pull/2

[jira] [Updated] (SPARK-32908) percentile_approx() returns incorrect results

2020-09-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-32908: --- Description: Read input data from the attached CSV file: {code:scala} val df = spark.read.opti

[jira] [Updated] (SPARK-32908) percentile_approx() returns incorrect results

2020-09-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-32908: --- Attachment: percentile_approx-input.csv > percentile_approx() returns incorrect results > --

[jira] [Commented] (SPARK-32908) percentile_approx() returns incorrect results

2020-09-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17197460#comment-17197460 ] Maxim Gekk commented on SPARK-32908: I am preparing a fix for the issue. > percenti

[jira] [Created] (SPARK-32908) percentile_approx() returns incorrect results

2020-09-17 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32908: -- Summary: percentile_approx() returns incorrect results Key: SPARK-32908 URL: https://issues.apache.org/jira/browse/SPARK-32908 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-32815) Fix LibSVM data source loading error on file paths with glob metacharacters

2020-09-07 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17191976#comment-17191976 ] Maxim Gekk commented on SPARK-32815: I am working on this. > Fix LibSVM data source

[jira] [Created] (SPARK-32815) Fix LibSVM data source loading error on file paths with glob metacharacters

2020-09-07 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32815: -- Summary: Fix LibSVM data source loading error on file paths with glob metacharacters Key: SPARK-32815 URL: https://issues.apache.org/jira/browse/SPARK-32815 Project: Spar

[jira] [Commented] (SPARK-32810) CSV/JSON data sources should avoid globbing paths when inferring schema

2020-09-07 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17191510#comment-17191510 ] Maxim Gekk commented on SPARK-32810: I am working on this. > CSV/JSON data sources

[jira] [Created] (SPARK-32810) CSV/JSON data sources should avoid globbing paths when inferring schema

2020-09-07 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32810: -- Summary: CSV/JSON data sources should avoid globbing paths when inferring schema Key: SPARK-32810 URL: https://issues.apache.org/jira/browse/SPARK-32810 Project: Spark

[jira] [Resolved] (SPARK-32108) Silent mode of spark-sql is broken

2020-09-01 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-32108. Resolution: Not A Problem > Silent mode of spark-sql is broken > -

[jira] [Commented] (SPARK-32637) SPARK SQL JDBC truncates last value of seconds for datetime2 values for Azure SQL DB

2020-09-01 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17188384#comment-17188384 ] Maxim Gekk commented on SPARK-32637: Spark's TIMESTAMP type has microsecond precisio

[jira] [Created] (SPARK-32599) Check the TEXTFILE file format in HiveSerDeReadWriteSuite

2020-08-12 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32599: -- Summary: Check the TEXTFILE file format in HiveSerDeReadWriteSuite Key: SPARK-32599 URL: https://issues.apache.org/jira/browse/SPARK-32599 Project: Spark Issue T

[jira] [Commented] (SPARK-32594) Insert wrong dates to Hive tables

2020-08-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175820#comment-17175820 ] Maxim Gekk commented on SPARK-32594: I am working on a fix > Insert wrong dates to

[jira] [Created] (SPARK-32594) Insert wrong dates to Hive tables

2020-08-11 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32594: -- Summary: Insert wrong dates to Hive tables Key: SPARK-32594 URL: https://issues.apache.org/jira/browse/SPARK-32594 Project: Spark Issue Type: Bug Compo

[jira] [Created] (SPARK-32546) SHOW VIEWS fails with MetaException ... ClassNotFoundException

2020-08-05 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32546: -- Summary: SHOW VIEWS fails with MetaException ... ClassNotFoundException Key: SPARK-32546 URL: https://issues.apache.org/jira/browse/SPARK-32546 Project: Spark I

[jira] [Created] (SPARK-32513) Rename classes/files with the Jdbc prefix to JDBC

2020-07-31 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32513: -- Summary: Rename classes/files with the Jdbc prefix to JDBC Key: SPARK-32513 URL: https://issues.apache.org/jira/browse/SPARK-32513 Project: Spark Issue Type: Imp

[jira] [Commented] (SPARK-32405) Apply table options while creating tables in JDBC Table Catalog

2020-07-31 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17169050#comment-17169050 ] Maxim Gekk commented on SPARK-32405: properties passed to createTable are ignored, s

[jira] [Created] (SPARK-32510) JDBC doesn't check duplicate column names in nested structures

2020-07-31 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32510: -- Summary: JDBC doesn't check duplicate column names in nested structures Key: SPARK-32510 URL: https://issues.apache.org/jira/browse/SPARK-32510 Project: Spark

[jira] [Created] (SPARK-32501) Inconsistent NULL conversions to strings

2020-07-30 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32501: -- Summary: Inconsistent NULL conversions to strings Key: SPARK-32501 URL: https://issues.apache.org/jira/browse/SPARK-32501 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-32499) Use {} for structs and maps in show()

2020-07-30 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32499: -- Summary: Use {} for structs and maps in show() Key: SPARK-32499 URL: https://issues.apache.org/jira/browse/SPARK-32499 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32396) Support the BATCH_READ capability by JDBCTable

2020-07-29 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167669#comment-17167669 ] Maxim Gekk commented on SPARK-32396: I am working on it. > Support the BATCH_READ c

[jira] [Created] (SPARK-32471) Describe JSON option `allowNonNumericNumbers`

2020-07-28 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32471: -- Summary: Describe JSON option `allowNonNumericNumbers` Key: SPARK-32471 URL: https://issues.apache.org/jira/browse/SPARK-32471 Project: Spark Issue Type: Documen

[jira] [Issue Comment Deleted] (SPARK-32431) The .schema() API behaves incorrectly for nested schemas that have column duplicates in case-insensitive mode

2020-07-27 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-32431: --- Comment: was deleted (was: I cannot reproduce the issue on master, branch-3.0 and branch-2.4. I ope

[jira] [Updated] (SPARK-32431) The .schema() API behaves incorrectly for nested schemas that have column duplicates in case-insensitive mode

2020-07-27 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-32431: --- Description: The code below throws org.apache.spark.sql.AnalysisException: Found duplicate column(s

[jira] [Commented] (SPARK-32431) The .schema() API behaves incorrectly for nested schemas that have column duplicates in case-insensitive mode

2020-07-25 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17164853#comment-17164853 ] Maxim Gekk commented on SPARK-32431: I cannot reproduce the issue on master, branch-

[jira] [Commented] (SPARK-32431) The .schema() API behaves incorrectly for nested schemas that have column duplicates in case-insensitive mode

2020-07-24 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17164499#comment-17164499 ] Maxim Gekk commented on SPARK-32431: I am working on this. > The .schema() API beha

[jira] [Created] (SPARK-32427) Omit USING in CREATE TABLE via JDBC Table Catalog

2020-07-24 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32427: -- Summary: Omit USING in CREATE TABLE via JDBC Table Catalog Key: SPARK-32427 URL: https://issues.apache.org/jira/browse/SPARK-32427 Project: Spark Issue Type: Sub

[jira] [Updated] (SPARK-32415) Enable JSON tests for the allowNonNumericNumbers option

2020-07-23 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-32415: --- Summary: Enable JSON tests for the allowNonNumericNumbers option (was: Enable JSON tests from the a

[jira] [Created] (SPARK-32415) Enable JSON tests from the allowNonNumericNumbers option

2020-07-23 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32415: -- Summary: Enable JSON tests from the allowNonNumericNumbers option Key: SPARK-32415 URL: https://issues.apache.org/jira/browse/SPARK-32415 Project: Spark Issue Ty

[jira] [Created] (SPARK-32410) Support the BATCH_WRITE capability by JDBCTable

2020-07-23 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32410: -- Summary: Support the BATCH_WRITE capability by JDBCTable Key: SPARK-32410 URL: https://issues.apache.org/jira/browse/SPARK-32410 Project: Spark Issue Type: Sub-t

[jira] [Updated] (SPARK-32396) Support the BATCH_READ capability by JDBCTable

2020-07-23 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-32396: --- Summary: Support the BATCH_READ capability by JDBCTable (was: Support BATCH_READ by JDBCTable) > S

[jira] [Updated] (SPARK-32410) Support the BATCH_WRITE capability by JDBCTable

2020-07-23 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-32410: --- Description: Extend JDBCTable introduced in https://github.com/apache/spark/pull/29168 by SupportsWr

[jira] [Created] (SPARK-32405) Apply table options while creating tables in JDBC Table Catalog

2020-07-23 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32405: -- Summary: Apply table options while creating tables in JDBC Table Catalog Key: SPARK-32405 URL: https://issues.apache.org/jira/browse/SPARK-32405 Project: Spark

[jira] [Created] (SPARK-32402) Implement ALTER TABLE in JDBC Table Catalog

2020-07-22 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32402: -- Summary: Implement ALTER TABLE in JDBC Table Catalog Key: SPARK-32402 URL: https://issues.apache.org/jira/browse/SPARK-32402 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-32396) Support BATCH_READ by JDBCTable

2020-07-22 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32396: -- Summary: Support BATCH_READ by JDBCTable Key: SPARK-32396 URL: https://issues.apache.org/jira/browse/SPARK-32396 Project: Spark Issue Type: Sub-task Co

[jira] [Created] (SPARK-32382) Override table renaming in JDBC dialects

2020-07-21 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32382: -- Summary: Override table renaming in JDBC dialects Key: SPARK-32382 URL: https://issues.apache.org/jira/browse/SPARK-32382 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-32375) Implement TableCatalog for JDBC

2020-07-20 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32375: -- Summary: Implement TableCatalog for JDBC Key: SPARK-32375 URL: https://issues.apache.org/jira/browse/SPARK-32375 Project: Spark Issue Type: Sub-task Co

[jira] [Commented] (SPARK-32328) Avro predicate pushdown for nested fields

2020-07-18 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160521#comment-17160521 ] Maxim Gekk commented on SPARK-32328: [~pavithraramachandran] Please, wait for the PR

[jira] [Commented] (SPARK-32346) Support filters pushdown in Avro datasource

2020-07-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159911#comment-17159911 ] Maxim Gekk commented on SPARK-32346: I am working on this > Support filters pushdow

[jira] [Created] (SPARK-32346) Support filters pushdown in Avro datasource

2020-07-17 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32346: -- Summary: Support filters pushdown in Avro datasource Key: SPARK-32346 URL: https://issues.apache.org/jira/browse/SPARK-32346 Project: Spark Issue Type: Improveme

[jira] [Updated] (SPARK-32346) Support filters pushdown in Avro datasource

2020-07-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-32346: --- Description: (was: * Implement the `SupportsPushDownFilters` interface in `JsonScanBuilder` * A

[jira] [Commented] (SPARK-32325) JSON predicate pushdown for nested fields

2020-07-15 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158902#comment-17158902 ] Maxim Gekk commented on SPARK-32325: The JIRA ticket was opened while addressing [~d

[jira] [Created] (SPARK-32325) JSON predicate pushdown for nested fields

2020-07-15 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32325: -- Summary: JSON predicate pushdown for nested fields Key: SPARK-32325 URL: https://issues.apache.org/jira/browse/SPARK-32325 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-32273) Support ANSI dialect in MAKE_DATE and MAKE_TIMESTAMP

2020-07-10 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17155337#comment-17155337 ] Maxim Gekk commented on SPARK-32273: [~Samwel] [~cloud_fan] I haven't found an umbre

[jira] [Created] (SPARK-32273) Support ANSI dialect in MAKE_DATE and MAKE_TIMESTAMP

2020-07-10 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32273: -- Summary: Support ANSI dialect in MAKE_DATE and MAKE_TIMESTAMP Key: SPARK-32273 URL: https://issues.apache.org/jira/browse/SPARK-32273 Project: Spark Issue Type:

[jira] [Created] (SPARK-32209) Re-use GetTimestamp in ParseToDate

2020-07-07 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32209: -- Summary: Re-use GetTimestamp in ParseToDate Key: SPARK-32209 URL: https://issues.apache.org/jira/browse/SPARK-32209 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-32173) Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-05 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32173: -- Summary: Deduplicate code in FromUTCTimestamp and ToUTCTimestamp Key: SPARK-32173 URL: https://issues.apache.org/jira/browse/SPARK-32173 Project: Spark Issue Typ

[jira] [Commented] (SPARK-31579) Replace floorDiv by / in localRebaseGregorianToJulianDays()

2020-07-02 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17150535#comment-17150535 ] Maxim Gekk commented on SPARK-31579: [~suddhuASF] Please, open a PR for master. > R

[jira] [Commented] (SPARK-32130) Spark 3.0 json load performance is unacceptable in comparison of Spark 2.4

2020-07-01 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149235#comment-17149235 ] Maxim Gekk commented on SPARK-32130: I would like to propose: # Add the SQL configĀ 

[jira] [Updated] (SPARK-32108) Silent mode of spark-sql is broken

2020-06-26 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-32108: --- Description: 1. I download the recent release Spark 3.0 from http://spark.apache.org/downloads.html

[jira] [Created] (SPARK-32108) Silent mode of spark-sql is broken

2020-06-26 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32108: -- Summary: Silent mode of spark-sql is broken Key: SPARK-32108 URL: https://issues.apache.org/jira/browse/SPARK-32108 Project: Spark Issue Type: Bug Comp

[jira] [Created] (SPARK-32072) Unaligned benchmark results

2020-06-23 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32072: -- Summary: Unaligned benchmark results Key: SPARK-32072 URL: https://issues.apache.org/jira/browse/SPARK-32072 Project: Spark Issue Type: Test Component

[jira] [Created] (SPARK-32071) Benchmark make_interval

2020-06-23 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32071: -- Summary: Benchmark make_interval Key: SPARK-32071 URL: https://issues.apache.org/jira/browse/SPARK-32071 Project: Spark Issue Type: Test Components: SQ

[jira] [Created] (SPARK-32052) Extract common code from date-time field expressions

2020-06-22 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32052: -- Summary: Extract common code from date-time field expressions Key: SPARK-32052 URL: https://issues.apache.org/jira/browse/SPARK-32052 Project: Spark Issue Type:

[jira] [Created] (SPARK-32043) Replace decimal by int op in `make_interval` and `make_timestamp`

2020-06-21 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32043: -- Summary: Replace decimal by int op in `make_interval` and `make_timestamp` Key: SPARK-32043 URL: https://issues.apache.org/jira/browse/SPARK-32043 Project: Spark

[jira] [Created] (SPARK-32006) Create date/timestamp formatters once before collect in `hiveResultString()`

2020-06-16 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32006: -- Summary: Create date/timestamp formatters once before collect in `hiveResultString()` Key: SPARK-32006 URL: https://issues.apache.org/jira/browse/SPARK-32006 Project: Spa

[jira] [Created] (SPARK-31992) Benchmark the EXCEPTION rebase mode

2020-06-14 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31992: -- Summary: Benchmark the EXCEPTION rebase mode Key: SPARK-31992 URL: https://issues.apache.org/jira/browse/SPARK-31992 Project: Spark Issue Type: Test Co

[jira] [Created] (SPARK-31989) Generate JSON files with rebasing switch points using smaller steps

2020-06-14 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31989: -- Summary: Generate JSON files with rebasing switch points using smaller steps Key: SPARK-31989 URL: https://issues.apache.org/jira/browse/SPARK-31989 Project: Spark

[jira] [Created] (SPARK-31986) Test failure RebaseDateTimeSuite."optimization of micros rebasing - Julian to Gregorian"

2020-06-14 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31986: -- Summary: Test failure RebaseDateTimeSuite."optimization of micros rebasing - Julian to Gregorian" Key: SPARK-31986 URL: https://issues.apache.org/jira/browse/SPARK-31986

[jira] [Created] (SPARK-31984) Make micros rebasing functions via local timestamps pure

2020-06-13 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31984: -- Summary: Make micros rebasing functions via local timestamps pure Key: SPARK-31984 URL: https://issues.apache.org/jira/browse/SPARK-31984 Project: Spark Issue Ty

[jira] [Created] (SPARK-31959) Test failure "RebaseDateTimeSuite.optimization of micros rebasing - Gregorian to Julian"

2020-06-10 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31959: -- Summary: Test failure "RebaseDateTimeSuite.optimization of micros rebasing - Gregorian to Julian" Key: SPARK-31959 URL: https://issues.apache.org/jira/browse/SPARK-31959

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-09 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129737#comment-17129737 ] Maxim Gekk commented on SPARK-26905: Spark's reserved keywords that are not reserved

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-09 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129730#comment-17129730 ] Maxim Gekk commented on SPARK-26905: Spark's ANSI Non-Reserved keywords are actually

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-09 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129729#comment-17129729 ] Maxim Gekk commented on SPARK-26905: I downloaded SQL2016 reserved and non-reserved

[jira] [Updated] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

2020-06-09 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-26905: --- Attachment: sql2016-02-nonreserved.txt sql2016-02-reserved.txt sql201

[jira] [Created] (SPARK-31940) Document the default JVM time zone in to/fromJavaDate and legacy date formatters

2020-06-09 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31940: -- Summary: Document the default JVM time zone in to/fromJavaDate and legacy date formatters Key: SPARK-31940 URL: https://issues.apache.org/jira/browse/SPARK-31940 Project:

[jira] [Created] (SPARK-31932) Add date/timestamp benchmarks for toHiveString

2020-06-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31932: -- Summary: Add date/timestamp benchmarks for toHiveString Key: SPARK-31932 URL: https://issues.apache.org/jira/browse/SPARK-31932 Project: Spark Issue Type: Test

[jira] [Resolved] (SPARK-30808) Thrift server returns wrong timestamps/dates strings before 1582

2020-06-04 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-30808. Resolution: Cannot Reproduce The example is not valid anymore because 'MILLENNIUM' is not supporte

[jira] [Created] (SPARK-31910) Enable Java 8 time API in Thrift server

2020-06-04 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31910: -- Summary: Enable Java 8 time API in Thrift server Key: SPARK-31910 URL: https://issues.apache.org/jira/browse/SPARK-31910 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-30808) Thrift server returns wrong timestamps/dates strings before 1582

2020-06-04 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30808: --- Affects Version/s: (was: 3.1.0) 3.0.0 > Thrift server returns wrong times

[jira] [Created] (SPARK-31901) Legacy date formatters don't use specified time zone

2020-06-03 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31901: -- Summary: Legacy date formatters don't use specified time zone Key: SPARK-31901 URL: https://issues.apache.org/jira/browse/SPARK-31901 Project: Spark Issue Type:

[jira] [Updated] (SPARK-31888) Support `java.time.Instant` in Parquet filter pushdown

2020-06-01 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-31888: --- Description: Currently, ParquetFilters supports only java.sql.Timestamp values of TimestampType, an

[jira] [Created] (SPARK-31888) Support `java.time.Instant` in Parquet filter pushdown

2020-06-01 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31888: -- Summary: Support `java.time.Instant` in Parquet filter pushdown Key: SPARK-31888 URL: https://issues.apache.org/jira/browse/SPARK-31888 Project: Spark Issue Type

[jira] [Created] (SPARK-31885) Incorrect filtering of old millis timestamp in parquet

2020-06-01 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31885: -- Summary: Incorrect filtering of old millis timestamp in parquet Key: SPARK-31885 URL: https://issues.apache.org/jira/browse/SPARK-31885 Project: Spark Issue Type

[jira] [Created] (SPARK-31878) Create date formatter only once in HiveResult

2020-05-31 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31878: -- Summary: Create date formatter only once in HiveResult Key: SPARK-31878 URL: https://issues.apache.org/jira/browse/SPARK-31878 Project: Spark Issue Type: Improve

[jira] [Created] (SPARK-31874) Use `FastDateFormat` as the legacy fractional formatter

2020-05-30 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31874: -- Summary: Use `FastDateFormat` as the legacy fractional formatter Key: SPARK-31874 URL: https://issues.apache.org/jira/browse/SPARK-31874 Project: Spark Issue Typ

[jira] [Comment Edited] (SPARK-31859) Thriftserver with spark.sql.datetime.java8API.enabled=true

2020-05-28 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17119029#comment-17119029 ] Maxim Gekk edited comment on SPARK-31859 at 5/28/20, 7:41 PM:

[jira] [Commented] (SPARK-31859) Thriftserver with spark.sql.datetime.java8API.enabled=true

2020-05-28 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17119029#comment-17119029 ] Maxim Gekk commented on SPARK-31859: [~juliuszsompolski] FYI https://github.com/apac

[jira] [Updated] (SPARK-31855) Check reading date/timestamp from Avro files w/ and w/o Spark version

2020-05-28 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-31855: --- Description: Extend the test "SPARK-31183: compatibility with Spark 2.4 in reading dates/timestamps

[jira] [Commented] (SPARK-31855) Check reading date/timestamp from Avro files w/ and w/o Spark version

2020-05-28 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17118468#comment-17118468 ] Maxim Gekk commented on SPARK-31855: I am working on it > Check reading date/timest

[jira] [Created] (SPARK-31855) Check reading date/timestamp from Avro files w/ and w/o Spark version

2020-05-28 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31855: -- Summary: Check reading date/timestamp from Avro files w/ and w/o Spark version Key: SPARK-31855 URL: https://issues.apache.org/jira/browse/SPARK-31855 Project: Spark

[jira] [Created] (SPARK-31820) Flaky JavaBeanDeserializationSuite

2020-05-25 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31820: -- Summary: Flaky JavaBeanDeserializationSuite Key: SPARK-31820 URL: https://issues.apache.org/jira/browse/SPARK-31820 Project: Spark Issue Type: Bug Comp

[jira] [Updated] (SPARK-31818) Failure on pushing down filters with java.time.Instant values in ORC

2020-05-25 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-31818: --- Description: When spark.sql.datetime.java8API.enabled is set to true, filters pushed down with java

[jira] [Created] (SPARK-31818) Failure on pushing down filters with java.time.Instant values in ORC

2020-05-25 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31818: -- Summary: Failure on pushing down filters with java.time.Instant values in ORC Key: SPARK-31818 URL: https://issues.apache.org/jira/browse/SPARK-31818 Project: Spark

[jira] [Created] (SPARK-31806) Check reading date/timestamp from Parquet: plain, dictionary enc, Spark version

2020-05-24 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31806: -- Summary: Check reading date/timestamp from Parquet: plain, dictionary enc, Spark version Key: SPARK-31806 URL: https://issues.apache.org/jira/browse/SPARK-31806 Project:

[jira] [Updated] (SPARK-31802) Format Java date-time types in Row.jsonValue directly

2020-05-22 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-31802: --- Description: Row.jsonValue has to convert incoming Java date/timestamps types to days/microseconds b

[jira] [Updated] (SPARK-31802) Format Java date-time types in Row.jsonValue directly

2020-05-22 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-31802: --- Description: Row.jsonValue has to convert incoming Java date/timestamps types to days/microseconds b

[jira] [Created] (SPARK-31802) Format Java date-time types in Row.jsonValue directly

2020-05-22 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31802: -- Summary: Format Java date-time types in Row.jsonValue directly Key: SPARK-31802 URL: https://issues.apache.org/jira/browse/SPARK-31802 Project: Spark Issue Type:

[jira] [Created] (SPARK-31785) Add a helper function to test all parquet readers

2020-05-21 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31785: -- Summary: Add a helper function to test all parquet readers Key: SPARK-31785 URL: https://issues.apache.org/jira/browse/SPARK-31785 Project: Spark Issue Type: Imp

[jira] [Created] (SPARK-31762) Fix perf regression of date/timestamp formatting in toHiveString

2020-05-19 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31762: -- Summary: Fix perf regression of date/timestamp formatting in toHiveString Key: SPARK-31762 URL: https://issues.apache.org/jira/browse/SPARK-31762 Project: Spark

[jira] [Created] (SPARK-31738) Describe 'L' and 'M' month pattern letters

2020-05-17 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31738: -- Summary: Describe 'L' and 'M' month pattern letters Key: SPARK-31738 URL: https://issues.apache.org/jira/browse/SPARK-31738 Project: Spark Issue Type: Documentat

[jira] [Created] (SPARK-31727) Inconsistent error messages of casting timestamp to int

2020-05-15 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31727: -- Summary: Inconsistent error messages of casting timestamp to int Key: SPARK-31727 URL: https://issues.apache.org/jira/browse/SPARK-31727 Project: Spark Issue Typ

[jira] [Created] (SPARK-31725) Set America/Los_Angeles time zone and Locale.US by default

2020-05-15 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31725: -- Summary: Set America/Los_Angeles time zone and Locale.US by default Key: SPARK-31725 URL: https://issues.apache.org/jira/browse/SPARK-31725 Project: Spark Issue

[jira] [Created] (SPARK-31712) Check casting timestamps to byte/short/int/long before 1970-01-01

2020-05-14 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31712: -- Summary: Check casting timestamps to byte/short/int/long before 1970-01-01 Key: SPARK-31712 URL: https://issues.apache.org/jira/browse/SPARK-31712 Project: Spark

[jira] [Created] (SPARK-31680) Support Java 8 datetime types by Random data generator

2020-05-11 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31680: -- Summary: Support Java 8 datetime types by Random data generator Key: SPARK-31680 URL: https://issues.apache.org/jira/browse/SPARK-31680 Project: Spark Issue Type

[jira] [Updated] (SPARK-31672) Reading wrong timestamps from dictionary encoded columns in Parquet files

2020-05-10 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-31672: --- Description: Write dates with dictionary encoding enabled to parquet files: {code:scala} Welcome to

[jira] [Created] (SPARK-31672) Reading wrong timestamps from dictionary encoded columns in Parquet files

2020-05-10 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31672: -- Summary: Reading wrong timestamps from dictionary encoded columns in Parquet files Key: SPARK-31672 URL: https://issues.apache.org/jira/browse/SPARK-31672 Project: Spark

<    1   2   3   4   5   6   7   8   9   10   >