[jira] [Created] (SPARK-20142) Move RewriteDistinctAggregates later into query execution

2017-03-29 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-20142: - Summary: Move RewriteDistinctAggregates later into query execution Key: SPARK-20142 URL: https://issues.apache.org/jira/browse/SPARK-20142 Project: Spark

[jira] [Created] (SPARK-20145) "SELECT * FROM range(1)" works, but "SELECT * FROM RANGE(1)" doesn't

2017-03-29 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-20145: - Summary: "SELECT * FROM range(1)" works, but "SELECT * FROM RANGE(1)" doesn't Key: SPARK-20145 URL: https://issues.apache.org/jira/browse/SPARK-20145

[jira] [Commented] (SPARK-20145) "SELECT * FROM range(1)" works, but "SELECT * FROM RANGE(1)" doesn't

2017-03-30 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949429#comment-15949429 ] Juliusz Sompolski commented on SPARK-20145: --- [~samelamin] sure, go ahead :-). > "SELECT * FROM

[jira] [Created] (SPARK-20311) SQL "range(N) as alias" or "range(N) alias" doesn't work

2017-04-12 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-20311: - Summary: SQL "range(N) as alias" or "range(N) alias" doesn't work Key: SPARK-20311 URL: https://issues.apache.org/jira/browse/SPARK-20311 Project: Spark

[jira] [Created] (SPARK-20412) NullPointerException in places expecting non-optional partitionSpec.

2017-04-20 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-20412: - Summary: NullPointerException in places expecting non-optional partitionSpec. Key: SPARK-20412 URL: https://issues.apache.org/jira/browse/SPARK-20412

[jira] [Updated] (SPARK-20412) NullPointerException in places expecting non-optional partitionSpec.

2017-04-20 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-20412: -- Description: A number of commands expect a partition specification without empty

[jira] [Commented] (SPARK-20367) Spark silently escapes partition column names

2017-04-18 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15972867#comment-15972867 ] Juliusz Sompolski commented on SPARK-20367: --- Hi [~hyukjin.kwon]. I tested also with parquet,

[jira] [Created] (SPARK-19948) Document that saveAsTable uses catalog as source of truth for table existence.

2017-03-14 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-19948: - Summary: Document that saveAsTable uses catalog as source of truth for table existence. Key: SPARK-19948 URL: https://issues.apache.org/jira/browse/SPARK-19948

[jira] [Created] (SPARK-20367) Spark silently escapes partition column names

2017-04-18 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-20367: - Summary: Spark silently escapes partition column names Key: SPARK-20367 URL: https://issues.apache.org/jira/browse/SPARK-20367 Project: Spark

[jira] [Created] (SPARK-21272) SortMergeJoin LeftAnti does not update numOutputRows

2017-06-30 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-21272: - Summary: SortMergeJoin LeftAnti does not update numOutputRows Key: SPARK-21272 URL: https://issues.apache.org/jira/browse/SPARK-21272 Project: Spark

[jira] [Created] (SPARK-20616) RuleExecutor logDebug of batch results should show diff to start of batch

2017-05-05 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-20616: - Summary: RuleExecutor logDebug of batch results should show diff to start of batch Key: SPARK-20616 URL: https://issues.apache.org/jira/browse/SPARK-20616

[jira] [Created] (SPARK-22103) Move HashAggregateExec parent consume to a separate function in codegen

2017-09-22 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-22103: - Summary: Move HashAggregateExec parent consume to a separate function in codegen Key: SPARK-22103 URL: https://issues.apache.org/jira/browse/SPARK-22103

[jira] [Commented] (SPARK-21907) NullPointerException in UnsafeExternalSorter.spill()

2017-09-06 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156036#comment-16156036 ] Juliusz Sompolski commented on SPARK-21907: --- [~kiszk] unfortunately I don't have a small scale

[jira] [Created] (SPARK-21907) NullPointerException in UnsafeExternalSorter.spill()

2017-09-04 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-21907: - Summary: NullPointerException in UnsafeExternalSorter.spill() Key: SPARK-21907 URL: https://issues.apache.org/jira/browse/SPARK-21907 Project: Spark

[jira] [Commented] (SPARK-21907) NullPointerException in UnsafeExternalSorter.spill()

2017-09-04 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152408#comment-16152408 ] Juliusz Sompolski commented on SPARK-21907: --- Note that UnsafeExternalSorter.spill appears twice

[jira] [Updated] (SPARK-22462) SQL metrics missing after foreach operation on dataframe

2017-11-06 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-22462: -- Attachment: collect.png foreach.png > SQL metrics missing after

[jira] [Created] (SPARK-22462) SQL metrics missing after foreach operation on dataframe

2017-11-06 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-22462: - Summary: SQL metrics missing after foreach operation on dataframe Key: SPARK-22462 URL: https://issues.apache.org/jira/browse/SPARK-22462 Project: Spark

[jira] [Created] (SPARK-22721) BytesToBytesMap peak memory usage not accurate after reset()

2017-12-06 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-22721: - Summary: BytesToBytesMap peak memory usage not accurate after reset() Key: SPARK-22721 URL: https://issues.apache.org/jira/browse/SPARK-22721 Project:

[jira] [Updated] (SPARK-24341) Codegen compile error from predicate subquery

2018-05-22 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-24341: -- Description: Ran on master: {code} drop table if exists juleka; drop table if exists

[jira] [Created] (SPARK-24341) Codegen compile error from predicate subquery

2018-05-22 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-24341: - Summary: Codegen compile error from predicate subquery Key: SPARK-24341 URL: https://issues.apache.org/jira/browse/SPARK-24341 Project: Spark

[jira] [Updated] (SPARK-24341) Codegen compile error from predicate subquery

2018-05-22 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-24341: -- Description: Ran on master: {code} drop table if exists juleka; drop table if exists

[jira] [Commented] (SPARK-24395) Fix Behavior of NOT IN with Literals Containing NULL

2018-05-29 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494181#comment-16494181 ] Juliusz Sompolski commented on SPARK-24395: --- The question is whether the literals should be

[jira] [Created] (SPARK-24104) SQLAppStatusListener overwrites metrics onDriverAccumUpdates instead of updating them

2018-04-26 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-24104: - Summary: SQLAppStatusListener overwrites metrics onDriverAccumUpdates instead of updating them Key: SPARK-24104 URL: https://issues.apache.org/jira/browse/SPARK-24104

[jira] [Created] (SPARK-23087) CheckCartesianProduct too restrictive when condition is constant folded to false/null

2018-01-16 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-23087: - Summary: CheckCartesianProduct too restrictive when condition is constant folded to false/null Key: SPARK-23087 URL: https://issues.apache.org/jira/browse/SPARK-23087

[jira] [Created] (SPARK-23366) Improve hot reading path in ReadAheadInputStream

2018-02-08 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-23366: - Summary: Improve hot reading path in ReadAheadInputStream Key: SPARK-23366 URL: https://issues.apache.org/jira/browse/SPARK-23366 Project: Spark

[jira] [Commented] (SPARK-23310) Perf regression introduced by SPARK-21113

2018-02-08 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16357890#comment-16357890 ] Juliusz Sompolski commented on SPARK-23310: --- [~kiszk] I raised SPARK-23366 and submitted

[jira] [Created] (SPARK-23445) ColumnStat refactoring

2018-02-15 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-23445: - Summary: ColumnStat refactoring Key: SPARK-23445 URL: https://issues.apache.org/jira/browse/SPARK-23445 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-22938) Assert that SQLConf.get is accessed only on the driver.

2018-01-02 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-22938: - Summary: Assert that SQLConf.get is accessed only on the driver. Key: SPARK-22938 URL: https://issues.apache.org/jira/browse/SPARK-22938 Project: Spark

[jira] [Created] (SPARK-22957) ApproxQuantile breaks if the number of rows exceeds MaxInt

2018-01-04 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-22957: - Summary: ApproxQuantile breaks if the number of rows exceeds MaxInt Key: SPARK-22957 URL: https://issues.apache.org/jira/browse/SPARK-22957 Project: Spark

[jira] [Created] (SPARK-25284) Spark UI: make sure skipped stages are updated onJobEnd

2018-08-30 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-25284: - Summary: Spark UI: make sure skipped stages are updated onJobEnd Key: SPARK-25284 URL: https://issues.apache.org/jira/browse/SPARK-25284 Project: Spark

[jira] [Commented] (SPARK-25284) Spark UI: make sure skipped stages are updated onJobEnd

2018-08-31 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598592#comment-16598592 ] Juliusz Sompolski commented on SPARK-25284: --- Contained by SPARK-24415 > Spark UI: make sure

[jira] [Resolved] (SPARK-25284) Spark UI: make sure skipped stages are updated onJobEnd

2018-08-31 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski resolved SPARK-25284. --- Resolution: Duplicate > Spark UI: make sure skipped stages are updated onJobEnd >

[jira] [Created] (SPARK-24013) ApproximatePercentile grinds to a halt on sorted input.

2018-04-18 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-24013: - Summary: ApproximatePercentile grinds to a halt on sorted input. Key: SPARK-24013 URL: https://issues.apache.org/jira/browse/SPARK-24013 Project: Spark

[jira] [Commented] (SPARK-24013) ApproximatePercentile grinds to a halt on sorted input.

2018-04-18 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442477#comment-16442477 ] Juliusz Sompolski commented on SPARK-24013: --- This hits when trying to create histogram

[jira] [Commented] (SPARK-24013) ApproximatePercentile grinds to a halt on sorted input.

2018-04-23 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448093#comment-16448093 ] Juliusz Sompolski commented on SPARK-24013: --- Hi [~mgaido] I tested again on current master

[jira] [Comment Edited] (SPARK-24013) ApproximatePercentile grinds to a halt on sorted input.

2018-04-23 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448093#comment-16448093 ] Juliusz Sompolski edited comment on SPARK-24013 at 4/23/18 1:11 PM:

[jira] [Updated] (SPARK-24013) ApproximatePercentile grinds to a halt on sorted input.

2018-04-23 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-24013: -- Attachment: screenshot-1.png > ApproximatePercentile grinds to a halt on sorted input.

[jira] [Created] (SPARK-25968) Non-codegen Floor and Ceil fail for FloatType

2018-11-08 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-25968: - Summary: Non-codegen Floor and Ceil fail for FloatType Key: SPARK-25968 URL: https://issues.apache.org/jira/browse/SPARK-25968 Project: Spark

[jira] [Resolved] (SPARK-25968) Non-codegen Floor and Ceil fail for FloatType

2018-11-08 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski resolved SPARK-25968. --- Resolution: Won't Fix Ok, I see it's not supposed to handle it, but type gets

[jira] [Created] (SPARK-26038) Decimal toScalaBigInt/toJavaBigInteger not work for decimals not fitting in long

2018-11-13 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-26038: - Summary: Decimal toScalaBigInt/toJavaBigInteger not work for decimals not fitting in long Key: SPARK-26038 URL: https://issues.apache.org/jira/browse/SPARK-26038

[jira] [Created] (SPARK-26622) Improve wording in SQLMetrics labels

2019-01-15 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-26622: - Summary: Improve wording in SQLMetrics labels Key: SPARK-26622 URL: https://issues.apache.org/jira/browse/SPARK-26622 Project: Spark Issue Type:

[jira] [Created] (SPARK-26159) Codegen for LocalTableScanExec

2018-11-23 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-26159: - Summary: Codegen for LocalTableScanExec Key: SPARK-26159 URL: https://issues.apache.org/jira/browse/SPARK-26159 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-27899) Make HiveMetastoreClient.getTableObjectsByName available in ExternalCatalog/SessionCatalog API

2019-05-31 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-27899: - Summary: Make HiveMetastoreClient.getTableObjectsByName available in ExternalCatalog/SessionCatalog API Key: SPARK-27899 URL:

[jira] [Commented] (SPARK-27899) Make HiveMetastoreClient.getTableObjectsByName available in ExternalCatalog/SessionCatalog API

2019-05-31 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853083#comment-16853083 ] Juliusz Sompolski commented on SPARK-27899: --- cc [~LI,Xiao], [~yumwang] > Make

[jira] [Created] (SPARK-28910) Prevent schema verification when connecting to in memory derby

2019-08-29 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-28910: - Summary: Prevent schema verification when connecting to in memory derby Key: SPARK-28910 URL: https://issues.apache.org/jira/browse/SPARK-28910 Project:

[jira] [Created] (SPARK-29056) ThriftServerSessionPage displays 1970/01/01 for queries that are not finished and not closed

2019-09-11 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-29056: - Summary: ThriftServerSessionPage displays 1970/01/01 for queries that are not finished and not closed Key: SPARK-29056 URL:

[jira] [Updated] (SPARK-29056) ThriftServerSessionPage displays 1970/01/01 for queries that are not finished and not closed

2019-09-11 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-29056: -- Issue Type: Bug (was: Improvement) > ThriftServerSessionPage displays 1970/01/01 for

[jira] [Created] (SPARK-29263) availableSlots in scheduler can change before being checked by barrier taskset

2019-09-26 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-29263: - Summary: availableSlots in scheduler can change before being checked by barrier taskset Key: SPARK-29263 URL: https://issues.apache.org/jira/browse/SPARK-29263

[jira] [Commented] (SPARK-29349) Support FETCH_PRIOR in Thriftserver query results fetching

2019-11-12 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972369#comment-16972369 ] Juliusz Sompolski commented on SPARK-29349: --- [~runzhiwang] it is used by Simba Spark ODBC

[jira] [Created] (SPARK-29349) Support FETCH_PRIOR in Thriftserver query results fetching

2019-10-03 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-29349: - Summary: Support FETCH_PRIOR in Thriftserver query results fetching Key: SPARK-29349 URL: https://issues.apache.org/jira/browse/SPARK-29349 Project: Spark

[jira] [Resolved] (SPARK-31051) Thriftserver operations other than SparkExecuteStatementOperation do not call onOperationClosed

2020-03-05 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski resolved SPARK-31051. --- Resolution: Not A Problem I'm just blind. They are there. > Thriftserver

[jira] [Created] (SPARK-31051) Thriftserver operations other than SparkExecuteStatementOperation do not call onOperationClosed

2020-03-05 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-31051: - Summary: Thriftserver operations other than SparkExecuteStatementOperation do not call onOperationClosed Key: SPARK-31051 URL:

[jira] [Created] (SPARK-31388) org.apache.spark.sql.hive.thriftserver.CliSuite result matching is flaky

2020-04-08 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-31388: - Summary: org.apache.spark.sql.hive.thriftserver.CliSuite result matching is flaky Key: SPARK-31388 URL: https://issues.apache.org/jira/browse/SPARK-31388

[jira] [Created] (SPARK-31204) HiveResult compatibility for DatasourceV2 command

2020-03-20 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-31204: - Summary: HiveResult compatibility for DatasourceV2 command Key: SPARK-31204 URL: https://issues.apache.org/jira/browse/SPARK-31204 Project: Spark

[jira] [Updated] (SPARK-31859) Thriftserver with spark.sql.datetime.java8API.enabled=true

2020-05-28 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-31859: -- Issue Type: Bug (was: Improvement) > Thriftserver with

[jira] [Created] (SPARK-31861) Thriftserver collecting timestamp not using spark.sql.session.timeZone

2020-05-28 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-31861: - Summary: Thriftserver collecting timestamp not using spark.sql.session.timeZone Key: SPARK-31861 URL: https://issues.apache.org/jira/browse/SPARK-31861

[jira] [Commented] (SPARK-31859) Thriftserver with spark.sql.datetime.java8API.enabled=true

2020-05-28 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119002#comment-17119002 ] Juliusz Sompolski commented on SPARK-31859: --- Actually, it's already in

[jira] [Created] (SPARK-31863) Thriftserver not setting active SparkSession, SQLConf.get not getting session configs correctly

2020-05-28 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-31863: - Summary: Thriftserver not setting active SparkSession, SQLConf.get not getting session configs correctly Key: SPARK-31863 URL:

[jira] [Created] (SPARK-31859) Thriftserver with spark.sql.datetime.java8API.enabled=true

2020-05-28 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-31859: - Summary: Thriftserver with spark.sql.datetime.java8API.enabled=true Key: SPARK-31859 URL: https://issues.apache.org/jira/browse/SPARK-31859 Project: Spark

[jira] [Commented] (SPARK-32132) Thriftserver interval returns "4 weeks 2 days" in 2.4 and "30 days" in 3.0

2020-06-30 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148848#comment-17148848 ] Juliusz Sompolski commented on SPARK-32132: --- Also 2.4 adds "interval" at the start, while 3.0

[jira] [Updated] (SPARK-32021) make_interval does not accept seconds >100

2020-06-18 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-32021: -- Description: In make_interval(years, months, weeks, days, hours, mins, secs), secs

[jira] [Created] (SPARK-32021) make_interval does not accept seconds >100

2020-06-18 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-32021: - Summary: make_interval does not accept seconds >100 Key: SPARK-32021 URL: https://issues.apache.org/jira/browse/SPARK-32021 Project: Spark Issue

[jira] [Commented] (SPARK-32132) Thriftserver interval returns "4 weeks 2 days" in 2.4 and "30 days" in 3.0

2020-06-29 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148086#comment-17148086 ] Juliusz Sompolski commented on SPARK-32132: --- cc [~hyukjin.kwon] [~cloud_fan] [~Qin Yao] >

[jira] [Created] (SPARK-32132) Thriftserver interval returns "4 weeks 2 days" in 2.4 and "30 days" in 3.0

2020-06-29 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-32132: - Summary: Thriftserver interval returns "4 weeks 2 days" in 2.4 and "30 days" in 3.0 Key: SPARK-32132 URL: https://issues.apache.org/jira/browse/SPARK-32132

[jira] [Commented] (SPARK-34152) CreateViewStatement.child should be a real child

2021-01-18 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267166#comment-17267166 ] Juliusz Sompolski commented on SPARK-34152: --- Same applies to AlterViewStatement. >

[jira] [Created] (SPARK-37090) Upgrade libthrift to resolve security vulnerabilities

2021-10-21 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-37090: - Summary: Upgrade libthrift to resolve security vulnerabilities Key: SPARK-37090 URL: https://issues.apache.org/jira/browse/SPARK-37090 Project: Spark

[jira] [Resolved] (SPARK-37090) Upgrade libthrift to resolve security vulnerabilities

2021-10-21 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski resolved SPARK-37090. --- Resolution: Duplicate > Upgrade libthrift to resolve security vulnerabilities >

[jira] [Commented] (SPARK-37090) Upgrade libthrift to resolve security vulnerabilities

2021-10-21 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17432731#comment-17432731 ] Juliusz Sompolski commented on SPARK-37090: --- Duplicate of

[jira] [Created] (SPARK-45133) Mark Spark Connect queries as finished when all result tasks are finished, not sent

2023-09-12 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-45133: - Summary: Mark Spark Connect queries as finished when all result tasks are finished, not sent Key: SPARK-45133 URL: https://issues.apache.org/jira/browse/SPARK-45133

[jira] [Updated] (SPARK-45167) Python Spark Connect client does not call `releaseAll`

2023-09-14 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-45167: -- Epic Link: SPARK-43754 (was: SPARK-39375) > Python Spark Connect client does not

[jira] [Created] (SPARK-45680) ReleaseSession to close Spark Connect session

2023-10-26 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-45680: - Summary: ReleaseSession to close Spark Connect session Key: SPARK-45680 URL: https://issues.apache.org/jira/browse/SPARK-45680 Project: Spark

[jira] [Updated] (SPARK-43754) Spark Connect Session & Query lifecycle

2023-10-26 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-43754: -- Affects Version/s: 4.0.0 > Spark Connect Session & Query lifecycle >

[jira] [Created] (SPARK-45780) Propagate all Spark Connect client threadlocal in InheritableThread

2023-11-03 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-45780: - Summary: Propagate all Spark Connect client threadlocal in InheritableThread Key: SPARK-45780 URL: https://issues.apache.org/jira/browse/SPARK-45780

[jira] [Created] (SPARK-45206) Shutting down SparkConnectClient can have outstanding ReleaseExecute

2023-09-18 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-45206: - Summary: Shutting down SparkConnectClient can have outstanding ReleaseExecute Key: SPARK-45206 URL: https://issues.apache.org/jira/browse/SPARK-45206

[jira] [Created] (SPARK-45416) Sanity check that Spark Connect returns arrow batches in order

2023-10-04 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-45416: - Summary: Sanity check that Spark Connect returns arrow batches in order Key: SPARK-45416 URL: https://issues.apache.org/jira/browse/SPARK-45416 Project:

[jira] [Created] (SPARK-45435) Document that lazy checkpoint may cause undeterministm

2023-10-06 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-45435: - Summary: Document that lazy checkpoint may cause undeterministm Key: SPARK-45435 URL: https://issues.apache.org/jira/browse/SPARK-45435 Project: Spark

[jira] [Updated] (SPARK-45435) Document that lazy checkpoint may not be a consistent

2023-10-06 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-45435: -- Summary: Document that lazy checkpoint may not be a consistent (was: Document that

[jira] [Created] (SPARK-45647) Spark Connect API to propagate per request context

2023-10-24 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-45647: - Summary: Spark Connect API to propagate per request context Key: SPARK-45647 URL: https://issues.apache.org/jira/browse/SPARK-45647 Project: Spark

[jira] [Resolved] (SPARK-44730) Spark Connect: Cleaner thread not stopped when SparkSession stops

2023-08-17 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski resolved SPARK-44730. --- Resolution: Not A Problem > Spark Connect: Cleaner thread not stopped when

[jira] [Commented] (SPARK-44730) Spark Connect: Cleaner thread not stopped when SparkSession stops

2023-08-17 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755613#comment-17755613 ] Juliusz Sompolski commented on SPARK-44730: --- Silly me, Cleaner is already global and I looked

[jira] [Created] (SPARK-44855) Small tweaks to attaching ExecuteGrpcResponseSender to ExecuteResponseObserver

2023-08-17 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44855: - Summary: Small tweaks to attaching ExecuteGrpcResponseSender to ExecuteResponseObserver Key: SPARK-44855 URL: https://issues.apache.org/jira/browse/SPARK-44855

[jira] [Resolved] (SPARK-44765) Make ReleaseExecute retry in ExecutePlanResponseReattachableIterator reuse common mechanism

2023-08-16 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski resolved SPARK-44765. --- Fix Version/s: 3.5.0 Resolution: Fixed > Make ReleaseExecute retry in

[jira] [Created] (SPARK-44833) Spark Connect reattach when initial ExecutePlan didn't reach server doing too eager Reattach

2023-08-16 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44833: - Summary: Spark Connect reattach when initial ExecutePlan didn't reach server doing too eager Reattach Key: SPARK-44833 URL:

[jira] [Created] (SPARK-44835) SparkConnect ReattachExecute could raise before ExecutePlan even attaches.

2023-08-16 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44835: - Summary: SparkConnect ReattachExecute could raise before ExecutePlan even attaches. Key: SPARK-44835 URL: https://issues.apache.org/jira/browse/SPARK-44835

[jira] [Created] (SPARK-44872) Testing reattachable execute

2023-08-18 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44872: - Summary: Testing reattachable execute Key: SPARK-44872 URL: https://issues.apache.org/jira/browse/SPARK-44872 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-44849) Expose SparkConnectExecutionManager.listActiveExecutions

2023-08-17 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44849: - Summary: Expose SparkConnectExecutionManager.listActiveExecutions Key: SPARK-44849 URL: https://issues.apache.org/jira/browse/SPARK-44849 Project: Spark

[jira] [Commented] (SPARK-44784) Failure in testing `SparkSessionE2ESuite` using Maven

2023-08-14 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17753974#comment-17753974 ] Juliusz Sompolski commented on SPARK-44784: --- This is a classloader issue with the

[jira] [Created] (SPARK-40918) Mismatch between ParquetFileFormat and FileSourceScanExec in # columns for WSCG.isTooManyFields when using _metadata

2022-10-26 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-40918: - Summary: Mismatch between ParquetFileFormat and FileSourceScanExec in # columns for WSCG.isTooManyFields when using _metadata Key: SPARK-40918 URL:

[jira] [Commented] (SPARK-20624) SPIP: Add better handling for node shutdown

2022-09-13 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17603577#comment-17603577 ] Juliusz Sompolski commented on SPARK-20624: --- [~holden] Are these new APIs documented? I can't

[jira] [Commented] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache

2023-01-02 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653648#comment-17653648 ] Juliusz Sompolski commented on SPARK-41497: --- Note that this issue leads to a correctness issue

[jira] [Comment Edited] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache

2023-01-02 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653648#comment-17653648 ] Juliusz Sompolski edited comment on SPARK-41497 at 1/2/23 4:22 PM: ---

[jira] [Created] (SPARK-43331) Spark Connect - SparkSession interruptAll

2023-05-01 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-43331: - Summary: Spark Connect - SparkSession interruptAll Key: SPARK-43331 URL: https://issues.apache.org/jira/browse/SPARK-43331 Project: Spark Issue

[jira] [Created] (SPARK-44424) Reattach to existing execute in Spark Connect (python client)

2023-07-14 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44424: - Summary: Reattach to existing execute in Spark Connect (python client) Key: SPARK-44424 URL: https://issues.apache.org/jira/browse/SPARK-44424 Project:

[jira] [Created] (SPARK-44423) Reattach to existing execute in Spark Connect (scala client)

2023-07-14 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44423: - Summary: Reattach to existing execute in Spark Connect (scala client) Key: SPARK-44423 URL: https://issues.apache.org/jira/browse/SPARK-44423 Project:

[jira] [Created] (SPARK-44422) Fine grained interrupt in Spark Connect

2023-07-14 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44422: - Summary: Fine grained interrupt in Spark Connect Key: SPARK-44422 URL: https://issues.apache.org/jira/browse/SPARK-44422 Project: Spark Issue

[jira] [Updated] (SPARK-44421) Reattach to existing execute in Spark Connect (server mechanism)

2023-07-14 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-44421: -- Summary: Reattach to existing execute in Spark Connect (server mechanism) (was:

[jira] [Created] (SPARK-44425) Validate that session_id is an UUID

2023-07-14 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44425: - Summary: Validate that session_id is an UUID Key: SPARK-44425 URL: https://issues.apache.org/jira/browse/SPARK-44425 Project: Spark Issue Type:

[jira] [Created] (SPARK-44421) Reattach to existing execute in Spark Connect

2023-07-14 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-44421: - Summary: Reattach to existing execute in Spark Connect Key: SPARK-44421 URL: https://issues.apache.org/jira/browse/SPARK-44421 Project: Spark

[jira] [Updated] (SPARK-43923) [CONNECT] Post listenerBus events during ExecutePlanRequest

2023-07-14 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-43923: -- Issue Type: New Feature (was: Bug) > [CONNECT] Post listenerBus events during

[jira] [Commented] (SPARK-43952) Cancel Spark jobs not only by a single "jobgroup", but allow multiple "job tags"

2023-06-02 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17728791#comment-17728791 ] Juliusz Sompolski commented on SPARK-43952: --- Indirectly related with

  1   2   >