[jira] [Updated] (SPARK-31915) Remove projection that adds grouping keys in grouped and cogrouped pandas UDFs

2020-06-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31915: - Description: Currently, grouped and cogrouped pandas UDFs in Spark unnecessarily projects the

[jira] [Commented] (SPARK-31563) Failure of InSet.sql for UTF8String collection

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127051#comment-17127051 ] Apache Spark commented on SPARK-31563: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31455) Fix rebasing of not-existed dates/timestamps

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127048#comment-17127048 ] Apache Spark commented on SPARK-31455: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31489) Failure on pushing down filters with java.time.LocalDate values in ORC

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127050#comment-17127050 ] Apache Spark commented on SPARK-31489: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31025) Support foldable input by `schema_of_csv`

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127049#comment-17127049 ] Apache Spark commented on SPARK-31025: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31553) Wrong result of isInCollection for large collections

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127052#comment-17127052 ] Apache Spark commented on SPARK-31553: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31471) Add a script to run multiple benchmarks

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31471: Assignee: Apache Spark > Add a script to run multiple benchmarks >

[jira] [Commented] (SPARK-31023) Support foldable schemas by `from_json`

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127047#comment-17127047 ] Apache Spark commented on SPARK-31023: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31471) Add a script to run multiple benchmarks

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31471: Assignee: (was: Apache Spark) > Add a script to run multiple benchmarks >

[jira] [Assigned] (SPARK-28624) make_date is inconsistent when reading from table

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28624: Assignee: Apache Spark > make_date is inconsistent when reading from table >

[jira] [Assigned] (SPARK-28624) make_date is inconsistent when reading from table

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28624: Assignee: (was: Apache Spark) > make_date is inconsistent when reading from table >

[jira] [Commented] (SPARK-30416) Log a warning for deprecated SQL config in `set()` and `unset()`

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127046#comment-17127046 ] Apache Spark commented on SPARK-30416: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-29920) Parsing failure on interval '20 15' day to hour

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127039#comment-17127039 ] Apache Spark commented on SPARK-29920: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-29173) Benchmark JDK 11 performance with FilterPushdownBenchmark

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127040#comment-17127040 ] Apache Spark commented on SPARK-29173: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-29712) fromDayTimeString() does not take into account the left bound

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29712: Assignee: (was: Apache Spark) > fromDayTimeString() does not take into account the

[jira] [Assigned] (SPARK-29750) Avoid dependency from joda-time

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29750: Assignee: (was: Apache Spark) > Avoid dependency from joda-time >

[jira] [Assigned] (SPARK-29712) fromDayTimeString() does not take into account the left bound

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29712: Assignee: Apache Spark > fromDayTimeString() does not take into account the left bound >

[jira] [Assigned] (SPARK-29440) Support java.time.Duration as an external type of CalendarIntervalType

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29440: Assignee: (was: Apache Spark) > Support java.time.Duration as an external type of

[jira] [Assigned] (SPARK-29440) Support java.time.Duration as an external type of CalendarIntervalType

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29440: Assignee: Apache Spark > Support java.time.Duration as an external type of

[jira] [Assigned] (SPARK-29750) Avoid dependency from joda-time

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29750: Assignee: Apache Spark > Avoid dependency from joda-time >

[jira] [Assigned] (SPARK-29524) Unordered interval units

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29524: Assignee: (was: Apache Spark) > Unordered interval units >

[jira] [Assigned] (SPARK-29524) Unordered interval units

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29524: Assignee: Apache Spark > Unordered interval units > > >

[jira] [Created] (SPARK-31917) Spark planner is extremely slow when struct transformation is used

2020-06-05 Thread Attila Kelemen (Jira)
Attila Kelemen created SPARK-31917: -- Summary: Spark planner is extremely slow when struct transformation is used Key: SPARK-31917 URL: https://issues.apache.org/jira/browse/SPARK-31917 Project:

[jira] [Commented] (SPARK-30501) Remove SQL config spark.sql.parquet.int64AsTimestampMillis

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127043#comment-17127043 ] Apache Spark commented on SPARK-30501: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-29920) Parsing failure on interval '20 15' day to hour

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127042#comment-17127042 ] Apache Spark commented on SPARK-29920: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-30309) Mark `Filter` as a `sealed` class

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127044#comment-17127044 ] Apache Spark commented on SPARK-30309: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-31915) Remove projection that adds grouping keys in grouped and cogrouped pandas UDFs

2020-06-05 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-31915: Summary: Remove projection that adds grouping keys in grouped and cogrouped pandas UDFs Key: SPARK-31915 URL: https://issues.apache.org/jira/browse/SPARK-31915

[jira] [Created] (SPARK-31916) StringConcat can overflow `length`, leads to StringIndexOutOfBoundsException

2020-06-05 Thread Jeffrey Stokes (Jira)
Jeffrey Stokes created SPARK-31916: -- Summary: StringConcat can overflow `length`, leads to StringIndexOutOfBoundsException Key: SPARK-31916 URL: https://issues.apache.org/jira/browse/SPARK-31916

[jira] [Commented] (SPARK-31903) toPandas with Arrow enabled doesn't show metrics in Query UI.

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127028#comment-17127028 ] Apache Spark commented on SPARK-31903: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-31903) toPandas with Arrow enabled doesn't show metrics in Query UI.

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127027#comment-17127027 ] Apache Spark commented on SPARK-31903: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-31563) Failure of InSet.sql for UTF8String collection

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127058#comment-17127058 ] Apache Spark commented on SPARK-31563: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31488) Support `java.time.LocalDate` in Parquet filter pushdown

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127056#comment-17127056 ] Apache Spark commented on SPARK-31488: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31553) Wrong result of isInCollection for large collections

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127054#comment-17127054 ] Apache Spark commented on SPARK-31553: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-29048) Query optimizer slow when using Column.isInCollection() with a large size collection

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127059#comment-17127059 ] Apache Spark commented on SPARK-29048: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31557) Legacy parser incorrectly interprets pre-Gregorian dates

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127055#comment-17127055 ] Apache Spark commented on SPARK-31557: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31044) Support foldable input by `schema_of_json`

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127053#comment-17127053 ] Apache Spark commented on SPARK-31044: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-29048) Query optimizer slow when using Column.isInCollection() with a large size collection

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29048: Assignee: (was: Apache Spark) > Query optimizer slow when using

[jira] [Assigned] (SPARK-29048) Query optimizer slow when using Column.isInCollection() with a large size collection

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29048: Assignee: Apache Spark > Query optimizer slow when using Column.isInCollection() with a

[jira] [Commented] (SPARK-31911) Using S3A staging committer, pending uploads are committed more than once and listed incorrectly in _SUCCESS data

2020-06-05 Thread Brandon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126936#comment-17126936 ] Brandon commented on SPARK-31911: - Thanks for looking [~ste...@apache.org], I attached logs to the

[jira] [Created] (SPARK-31910) Enable Java 8 time API in Thrift server

2020-06-05 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31910: -- Summary: Enable Java 8 time API in Thrift server Key: SPARK-31910 URL: https://issues.apache.org/jira/browse/SPARK-31910 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-30808) Thrift server returns wrong timestamps/dates strings before 1582

2020-06-05 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30808: --- Affects Version/s: (was: 3.1.0) 3.0.0 > Thrift server returns wrong

[jira] [Assigned] (SPARK-31910) Enable Java 8 time API in Thrift server

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31910: Assignee: (was: Apache Spark) > Enable Java 8 time API in Thrift server >

[jira] [Assigned] (SPARK-31910) Enable Java 8 time API in Thrift server

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31910: Assignee: Apache Spark > Enable Java 8 time API in Thrift server >

[jira] [Assigned] (SPARK-31910) Enable Java 8 time API in Thrift server

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31910: Assignee: Apache Spark > Enable Java 8 time API in Thrift server >

[jira] [Commented] (SPARK-31910) Enable Java 8 time API in Thrift server

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126453#comment-17126453 ] Apache Spark commented on SPARK-31910: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31884) Support MongoDB Kerberos login in JDBC connector

2020-06-05 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126510#comment-17126510 ] Gabor Somogyi commented on SPARK-31884: --- Sorry, my question was not exact enough. The server side

[jira] [Commented] (SPARK-31908) Spark UI shows wrong driver memory configurations if driver memory is provided at run time

2020-06-05 Thread pavithra ramachandran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126419#comment-17126419 ] pavithra ramachandran commented on SPARK-31908: --- i would like to work on this > Spark UI

[jira] [Reopened] (SPARK-30808) Thrift server returns wrong timestamps/dates strings before 1582

2020-06-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-30808: -- > Thrift server returns wrong timestamps/dates strings before 1582 >

[jira] [Updated] (SPARK-30808) Thrift server returns wrong timestamps/dates strings before 1582

2020-06-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-30808: - Affects Version/s: (was: 3.0.0) 3.1.0 > Thrift server returns wrong

[jira] [Updated] (SPARK-30808) Thrift server returns wrong timestamps/dates strings before 1582

2020-06-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-30808: - Fix Version/s: (was: 3.0.0) > Thrift server returns wrong timestamps/dates strings before

[jira] [Resolved] (SPARK-30808) Thrift server returns wrong timestamps/dates strings before 1582

2020-06-05 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-30808. Resolution: Cannot Reproduce The example is not valid anymore because 'MILLENNIUM' is not

[jira] [Updated] (SPARK-31809) Infer IsNotNull for non null intolerant child of null intolerant in join condition

2020-06-05 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-31809: Summary: Infer IsNotNull for non null intolerant child of null intolerant in join condition

[jira] [Updated] (SPARK-28624) make_date is inconsistent when reading from table

2020-06-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28624: - Fix Version/s: (was: 3.1.0) > make_date is inconsistent when reading from table >

[jira] [Commented] (SPARK-28624) make_date is inconsistent when reading from table

2020-06-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126451#comment-17126451 ] Hyukjin Kwon commented on SPARK-28624: -- Reverted at

[jira] [Reopened] (SPARK-28624) make_date is inconsistent when reading from table

2020-06-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-28624: -- Assignee: (was: Maxim Gekk) > make_date is inconsistent when reading from table >

[jira] [Commented] (SPARK-31705) Rewrite join condition to conjunctive normal form

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126513#comment-17126513 ] Apache Spark commented on SPARK-31705: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-31911) Using S3A staging committer, pending uploads are committed more than once and listed incorrectly in _SUCCESS data

2020-06-05 Thread Brandon (Jira)
Brandon created SPARK-31911: --- Summary: Using S3A staging committer, pending uploads are committed more than once and listed incorrectly in _SUCCESS data Key: SPARK-31911 URL:

[jira] [Updated] (SPARK-31911) Using S3A staging committer, pending uploads are committed more than once and listed incorrectly in _SUCCESS data

2020-06-05 Thread Brandon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon updated SPARK-31911: Description: First of all thanks for the great work on the S3 committers. I was able set up the

[jira] [Updated] (SPARK-31911) Using S3A staging committer, pending uploads are committed more than once and listed incorrectly in _SUCCESS data

2020-06-05 Thread Brandon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon updated SPARK-31911: Description: First of all thanks for the great work on the S3 committers. I was able set up the

[jira] [Commented] (SPARK-31861) Thriftserver collecting timestamp not using spark.sql.session.timeZone

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126569#comment-17126569 ] Apache Spark commented on SPARK-31861: -- User 'juliuszsompolski' has created a pull request for this

[jira] [Commented] (SPARK-31861) Thriftserver collecting timestamp not using spark.sql.session.timeZone

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126568#comment-17126568 ] Apache Spark commented on SPARK-31861: -- User 'juliuszsompolski' has created a pull request for this

[jira] [Commented] (SPARK-31861) Thriftserver collecting timestamp not using spark.sql.session.timeZone

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126567#comment-17126567 ] Apache Spark commented on SPARK-31861: -- User 'juliuszsompolski' has created a pull request for this

[jira] [Commented] (SPARK-31859) Thriftserver with spark.sql.datetime.java8API.enabled=true

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126566#comment-17126566 ] Apache Spark commented on SPARK-31859: -- User 'juliuszsompolski' has created a pull request for this

[jira] [Commented] (SPARK-31911) Using S3A staging committer, pending uploads are committed more than once and listed incorrectly in _SUCCESS data

2020-06-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126608#comment-17126608 ] Steve Loughran commented on SPARK-31911: BTW, given we complete the multipart uploads only once,

[jira] [Commented] (SPARK-31817) Pass-through of Kerberos credentials from Spark SQL to a jdbc source

2020-06-05 Thread Luis Lozano Coira (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126622#comment-17126622 ] Luis Lozano Coira commented on SPARK-31817: --- I am not aware of the implementation details of

[jira] [Updated] (SPARK-31911) Using S3A staging committer, pending uploads are committed more than once and listed incorrectly in _SUCCESS data

2020-06-05 Thread Brandon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon updated SPARK-31911: Description: First of all thanks for the great work on the S3 committers. I was able set up the

[jira] [Updated] (SPARK-31911) Using S3A staging committer, pending uploads are committed more than once and listed incorrectly in _SUCCESS data

2020-06-05 Thread Brandon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon updated SPARK-31911: Description: First of all thanks for the great work on the S3 committers. I was able set up the

[jira] [Updated] (SPARK-31912) Normalize all binary comparison expressions

2020-06-05 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-31912: Summary: Normalize all binary comparison expressions (was: Normalize all binary comparison

[jira] [Created] (SPARK-31912) Normalize all binary comparison expression

2020-06-05 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-31912: --- Summary: Normalize all binary comparison expression Key: SPARK-31912 URL: https://issues.apache.org/jira/browse/SPARK-31912 Project: Spark Issue Type:

[jira] [Created] (SPARK-31913) StackOverflowError in FileScanRDD

2020-06-05 Thread Genmao Yu (Jira)
Genmao Yu created SPARK-31913: - Summary: StackOverflowError in FileScanRDD Key: SPARK-31913 URL: https://issues.apache.org/jira/browse/SPARK-31913 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-31912) Normalize all binary comparison expressions

2020-06-05 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-31912: Description: This test will fail: {code:scala} test("SPARK-31912 Normalize all binary

[jira] [Commented] (SPARK-31911) Using S3A staging committer, pending uploads are committed more than once and listed incorrectly in _SUCCESS data

2020-06-05 Thread Brandon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126556#comment-17126556 ] Brandon commented on SPARK-31911: - Interesting, it looks like the staging committer supports a

[jira] [Comment Edited] (SPARK-31911) Using S3A staging committer, pending uploads are committed more than once and listed incorrectly in _SUCCESS data

2020-06-05 Thread Brandon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126556#comment-17126556 ] Brandon edited comment on SPARK-31911 at 6/5/20, 8:53 AM: -- Interesting, it

[jira] [Commented] (SPARK-31859) Thriftserver with spark.sql.datetime.java8API.enabled=true

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126565#comment-17126565 ] Apache Spark commented on SPARK-31859: -- User 'juliuszsompolski' has created a pull request for this

[jira] [Commented] (SPARK-31911) Using S3A staging committer, pending uploads are committed more than once and listed incorrectly in _SUCCESS data

2020-06-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126606#comment-17126606 ] Steve Loughran commented on SPARK-31911: thanks for this. Created HADOOP-17066 I'd like to see

[jira] [Commented] (SPARK-31867) Fix silent data change for datetime formatting

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126652#comment-17126652 ] Apache Spark commented on SPARK-31867: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31913) StackOverflowError in FileScanRDD

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31913: Assignee: Apache Spark > StackOverflowError in FileScanRDD >

[jira] [Assigned] (SPARK-31913) StackOverflowError in FileScanRDD

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31913: Assignee: (was: Apache Spark) > StackOverflowError in FileScanRDD >

[jira] [Commented] (SPARK-31913) StackOverflowError in FileScanRDD

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126664#comment-17126664 ] Apache Spark commented on SPARK-31913: -- User 'uncleGen' has created a pull request for this issue:

[jira] [Commented] (SPARK-31683) Make Prometheus output consistent with DropWizard 4.1 result

2020-06-05 Thread Jorge Machado (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126671#comment-17126671 ] Jorge Machado commented on SPARK-31683: --- [~dongjoon] this only exporters the metrics from the

[jira] [Assigned] (SPARK-31879) First day of week changed for non-MONDAY_START Lacales

2020-06-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31879: --- Assignee: Wenchen Fan > First day of week changed for non-MONDAY_START Lacales >

[jira] [Assigned] (SPARK-31912) Normalize all binary comparison expressions

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31912: Assignee: (was: Apache Spark) > Normalize all binary comparison expressions >

[jira] [Assigned] (SPARK-31912) Normalize all binary comparison expressions

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31912: Assignee: Apache Spark > Normalize all binary comparison expressions >

[jira] [Commented] (SPARK-31912) Normalize all binary comparison expressions

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126553#comment-17126553 ] Apache Spark commented on SPARK-31912: -- User 'wangyum' has created a pull request for this issue:

[jira] [Reopened] (SPARK-31879) First day of week changed for non-MONDAY_START Lacales

2020-06-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-31879: - Assignee: Kent Yao (was: Wenchen Fan) > First day of week changed for non-MONDAY_START

[jira] [Resolved] (SPARK-31879) First day of week changed for non-MONDAY_START Lacales

2020-06-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31879. - Fix Version/s: 3.0.0 Resolution: Fixed > First day of week changed for non-MONDAY_START

[jira] [Commented] (SPARK-31911) Using S3A staging committer, pending uploads are committed more than once and listed incorrectly in _SUCCESS data

2020-06-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126609#comment-17126609 ] Steve Loughran commented on SPARK-31911: FYI [~mackrorysd] > Using S3A staging committer,

[jira] [Commented] (SPARK-31867) Fix silent data change for datetime formatting

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126654#comment-17126654 ] Apache Spark commented on SPARK-31867: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-31914) Apply SharedThriftServer to all ThriftServer related tests

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126745#comment-17126745 ] Apache Spark commented on SPARK-31914: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Created] (SPARK-31914) Apply SharedThriftServer to all ThriftServer related tests

2020-06-05 Thread Kent Yao (Jira)
Kent Yao created SPARK-31914: Summary: Apply SharedThriftServer to all ThriftServer related tests Key: SPARK-31914 URL: https://issues.apache.org/jira/browse/SPARK-31914 Project: Spark Issue

[jira] [Assigned] (SPARK-31914) Apply SharedThriftServer to all ThriftServer related tests

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31914: Assignee: Apache Spark > Apply SharedThriftServer to all ThriftServer related tests >

[jira] [Assigned] (SPARK-31914) Apply SharedThriftServer to all ThriftServer related tests

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31914: Assignee: (was: Apache Spark) > Apply SharedThriftServer to all ThriftServer related

[jira] [Commented] (SPARK-31914) Apply SharedThriftServer to all ThriftServer related tests

2020-06-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126743#comment-17126743 ] Apache Spark commented on SPARK-31914: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Resolved] (SPARK-31910) Enable Java 8 time API in Thrift server

2020-06-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31910. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28729

[jira] [Assigned] (SPARK-31910) Enable Java 8 time API in Thrift server

2020-06-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31910: --- Assignee: Maxim Gekk (was: Apache Spark) > Enable Java 8 time API in Thrift server >