[jira] [Assigned] (SPARK-28419) A patch for SparkThriftServer support multi-tenant authentication

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28419: Assignee: (was: Apache Spark) > A patch for SparkThriftServer support multi-tenant au

[jira] [Assigned] (SPARK-28710) [UDF] create or replace permanent function does not clear the jar in class path

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28710: Assignee: (was: Apache Spark) > [UDF] create or replace permanent function does not c

[jira] [Assigned] (SPARK-28710) [UDF] create or replace permanent function does not clear the jar in class path

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28710: Assignee: Apache Spark > [UDF] create or replace permanent function does not clear the ja

[jira] [Assigned] (SPARK-24915) Calling SparkSession.createDataFrame with schema can throw exception

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24915: Assignee: (was: Apache Spark) > Calling SparkSession.createDataFrame with schema can

[jira] [Assigned] (SPARK-29431) Improve Web UI / Sql tab visualization with cached dataframes.

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29431: Assignee: (was: Apache Spark) > Improve Web UI / Sql tab visualization with cached da

[jira] [Assigned] (SPARK-28948) Support passing all Table metadata in TableProvider

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28948: Assignee: Wenchen Fan (was: Apache Spark) > Support passing all Table metadata in TableP

[jira] [Assigned] (SPARK-24915) Calling SparkSession.createDataFrame with schema can throw exception

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24915: Assignee: Apache Spark > Calling SparkSession.createDataFrame with schema can throw excep

[jira] [Assigned] (SPARK-29018) Build spark thrift server on it's own code based on protocol v11

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29018: Assignee: (was: Apache Spark) > Build spark thrift server on it's own code based on p

[jira] [Assigned] (SPARK-28992) Support update dependencies from hdfs when task run on executor pods

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28992: Assignee: (was: Apache Spark) > Support update dependencies from hdfs when task run o

[jira] [Assigned] (SPARK-27936) Support local dependency uploading from --py-files

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27936: Assignee: Apache Spark > Support local dependency uploading from --py-files > ---

[jira] [Assigned] (SPARK-28551) CTAS SQL with LOCATION properties won't check location path, cause data under this location lose

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28551: Assignee: (was: Apache Spark) > CTAS SQL with LOCATION properties won't check locatio

[jira] [Assigned] (SPARK-25065) Driver and executors pick the wrong logging configuration file.

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25065: Assignee: (was: Apache Spark) > Driver and executors pick the wrong logging configura

[jira] [Assigned] (SPARK-29683) Job failed due to executor failures all available nodes are blacklisted

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29683: Assignee: (was: Apache Spark) > Job failed due to executor failures all available nod

[jira] [Assigned] (SPARK-29577) Implement p-value simulation and unit tests for chi2 test

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29577: Assignee: Apache Spark > Implement p-value simulation and unit tests for chi2 test >

[jira] [Assigned] (SPARK-28551) CTAS SQL with LOCATION properties won't check location path, cause data under this location lose

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28551: Assignee: Apache Spark > CTAS SQL with LOCATION properties won't check location path, cau

[jira] [Updated] (SPARK-24266) Spark client terminates while driver is still running

2020-04-30 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-24266: - Target Version/s: 2.4.6, 3.0.0, 3.1.0 > Spark client terminates while driver is still running >

[jira] [Assigned] (SPARK-31618) Pushdown Distinct through Join in IntersectDistinct based on stats

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31618: Assignee: (was: Apache Spark) > Pushdown Distinct through Join in IntersectDistinct b

[jira] [Commented] (SPARK-31618) Pushdown Distinct through Join in IntersectDistinct based on stats

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096729#comment-17096729 ] Apache Spark commented on SPARK-31618: -- User 'prakharjain09' has created a pull req

[jira] [Assigned] (SPARK-31618) Pushdown Distinct through Join in IntersectDistinct based on stats

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31618: Assignee: Apache Spark > Pushdown Distinct through Join in IntersectDistinct based on sta

[jira] [Created] (SPARK-31618) Pushdown Distinct through Join in IntersectDistinct based on stats

2020-04-30 Thread Prakhar Jain (Jira)
Prakhar Jain created SPARK-31618: Summary: Pushdown Distinct through Join in IntersectDistinct based on stats Key: SPARK-31618 URL: https://issues.apache.org/jira/browse/SPARK-31618 Project: Spark

[jira] [Commented] (SPARK-27340) Alias on TimeWIndow expression may cause watermark metadata lost

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096710#comment-17096710 ] Apache Spark commented on SPARK-27340: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-31538) Backport SPARK-25338 Ensure to call super.beforeAll() and super.afterAll() in test cases

2020-04-30 Thread Kazuaki Ishizaki (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096707#comment-17096707 ] Kazuaki Ishizaki commented on SPARK-31538: -- Do we want to port this to 2.4.6 an

[jira] [Commented] (SPARK-29048) Query optimizer slow when using Column.isInCollection() with a large size collection

2020-04-30 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096705#comment-17096705 ] Holden Karau commented on SPARK-29048: -- Do we have context for the reason of revert

[jira] [Updated] (SPARK-29048) Query optimizer slow when using Column.isInCollection() with a large size collection

2020-04-30 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-29048: - Target Version/s: 2.4.6 Affects Version/s: 2.4.6 2.4.5 > Query optim

[jira] [Commented] (SPARK-31538) Backport SPARK-25338 Ensure to call super.beforeAll() and super.afterAll() in test cases

2020-04-30 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096704#comment-17096704 ] Holden Karau commented on SPARK-31538: -- So a test reliability improvement that woul

[jira] [Commented] (SPARK-31399) Closure cleaner broken in Scala 2.12

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096629#comment-17096629 ] Dongjoon Hyun commented on SPARK-31399: --- Thank you so much, [~rednaxelafx]. > Clo

[jira] [Assigned] (SPARK-29303) UI updates for stage level scheduling

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29303: Assignee: (was: Apache Spark) > UI updates for stage level scheduling > -

[jira] [Assigned] (SPARK-29303) UI updates for stage level scheduling

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29303: Assignee: Apache Spark > UI updates for stage level scheduling >

[jira] [Created] (SPARK-31617) support drop multiple functions

2020-04-30 Thread jobit mathew (Jira)
jobit mathew created SPARK-31617: Summary: support drop multiple functions Key: SPARK-31617 URL: https://issues.apache.org/jira/browse/SPARK-31617 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-24266) Spark client terminates while driver is still running

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24266: Assignee: (was: Apache Spark) > Spark client terminates while driver is still running

[jira] [Assigned] (SPARK-24266) Spark client terminates while driver is still running

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24266: Assignee: Apache Spark > Spark client terminates while driver is still running >

[jira] [Commented] (SPARK-24266) Spark client terminates while driver is still running

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096554#comment-17096554 ] Apache Spark commented on SPARK-24266: -- User 'stijndehaes' has created a pull reque

[jira] [Assigned] (SPARK-31610) Expose hashFunc property in HashingTF

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31610: Assignee: Apache Spark > Expose hashFunc property in HashingTF >

[jira] [Commented] (SPARK-31610) Expose hashFunc property in HashingTF

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096537#comment-17096537 ] Apache Spark commented on SPARK-31610: -- User 'WeichenXu123' has created a pull requ

[jira] [Assigned] (SPARK-31610) Expose hashFunc property in HashingTF

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31610: Assignee: (was: Apache Spark) > Expose hashFunc property in HashingTF > -

[jira] [Commented] (SPARK-31307) Add FValueTest Examples

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096511#comment-17096511 ] Apache Spark commented on SPARK-31307: -- User 'kevinyu98' has created a pull request

[jira] [Commented] (SPARK-31307) Add FValueTest Examples

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096509#comment-17096509 ] Apache Spark commented on SPARK-31307: -- User 'kevinyu98' has created a pull request

[jira] [Assigned] (SPARK-31307) Add FValueTest Examples

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31307: Assignee: (was: Apache Spark) > Add FValueTest Examples > --- > >

[jira] [Assigned] (SPARK-31307) Add FValueTest Examples

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31307: Assignee: Apache Spark > Add FValueTest Examples > --- > >

[jira] [Assigned] (SPARK-31257) Fix ambiguous two different CREATE TABLE syntaxes

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31257: Assignee: (was: Apache Spark) > Fix ambiguous two different CREATE TABLE syntaxes > -

[jira] [Assigned] (SPARK-31257) Fix ambiguous two different CREATE TABLE syntaxes

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31257: Assignee: Apache Spark > Fix ambiguous two different CREATE TABLE syntaxes >

[jira] [Commented] (SPARK-31599) Reading from S3 (Structured Streaming Bucket) Fails after Compaction

2020-04-30 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096492#comment-17096492 ] Gabor Somogyi commented on SPARK-31599: --- Now I see, as [~kabhwan] said there is no

[jira] [Assigned] (SPARK-31559) AM starts with initial fetched tokens in any attempt

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31559: Assignee: (was: Apache Spark) > AM starts with initial fetched tokens in any attempt

[jira] [Assigned] (SPARK-31559) AM starts with initial fetched tokens in any attempt

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31559: Assignee: Apache Spark > AM starts with initial fetched tokens in any attempt > -

[jira] [Assigned] (SPARK-30900) FileStreamSource: Avoid reading compact metadata log twice if the query stops from compact batch and restarts

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30900: Assignee: (was: Apache Spark) > FileStreamSource: Avoid reading compact metadata log

[jira] [Assigned] (SPARK-30900) FileStreamSource: Avoid reading compact metadata log twice if the query stops from compact batch and restarts

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30900: Assignee: Apache Spark > FileStreamSource: Avoid reading compact metadata log twice if th

[jira] [Assigned] (SPARK-30294) Read-only state store unnecessarily creates and deletes the temp file for delta file every batch

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30294: Assignee: Apache Spark > Read-only state store unnecessarily creates and deletes the temp

[jira] [Assigned] (SPARK-30294) Read-only state store unnecessarily creates and deletes the temp file for delta file every batch

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30294: Assignee: (was: Apache Spark) > Read-only state store unnecessarily creates and delet

[jira] [Assigned] (SPARK-30866) FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30866: Assignee: (was: Apache Spark) > FileStreamSource: Cache fetched list of files beyond

[jira] [Assigned] (SPARK-30866) FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30866: Assignee: Apache Spark > FileStreamSource: Cache fetched list of files beyond maxFilesPer

[jira] [Assigned] (SPARK-26425) Add more constraint checks in file streaming source to avoid checkpoint corruption

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26425: Assignee: Tathagata Das (was: Apache Spark) > Add more constraint checks in file streami

[jira] [Assigned] (SPARK-26425) Add more constraint checks in file streaming source to avoid checkpoint corruption

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26425: Assignee: Apache Spark (was: Tathagata Das) > Add more constraint checks in file streami

[jira] [Resolved] (SPARK-31599) Reading from S3 (Structured Streaming Bucket) Fails after Compaction

2020-04-30 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-31599. -- Resolution: Invalid > Reading from S3 (Structured Streaming Bucket) Fails after Compaction > -

[jira] [Commented] (SPARK-31599) Reading from S3 (Structured Streaming Bucket) Fails after Compaction

2020-04-30 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096483#comment-17096483 ] Jungtaek Lim commented on SPARK-31599: -- You understand how file stream sink and fil

[jira] [Assigned] (SPARK-31393) Show the correct alias in a more elegant way

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31393: Assignee: (was: Apache Spark) > Show the correct alias in a more elegant way > --

[jira] [Assigned] (SPARK-31393) Show the correct alias in a more elegant way

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31393: Assignee: Apache Spark > Show the correct alias in a more elegant way > -

[jira] [Assigned] (SPARK-17604) Support purging aged file entry for FileStreamSource metadata log

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-17604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17604: Assignee: Apache Spark > Support purging aged file entry for FileStreamSource metadata lo

[jira] [Assigned] (SPARK-17604) Support purging aged file entry for FileStreamSource metadata log

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-17604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17604: Assignee: (was: Apache Spark) > Support purging aged file entry for FileStreamSource

[jira] [Commented] (SPARK-17604) Support purging aged file entry for FileStreamSource metadata log

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-17604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096473#comment-17096473 ] Apache Spark commented on SPARK-17604: -- User 'HeartSaVioR' has created a pull reque

[jira] [Resolved] (SPARK-31607) Improve the perf of CTESubstitution

2020-04-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31607. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28407 [https://gith

[jira] [Commented] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096419#comment-17096419 ] Apache Spark commented on SPARK-31500: -- User 'planga82' has created a pull request

[jira] [Assigned] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31500: Assignee: (was: Apache Spark) > collect_set() of BinaryType returns duplicate element

[jira] [Assigned] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31500: Assignee: Apache Spark > collect_set() of BinaryType returns duplicate elements > ---

[jira] [Commented] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096418#comment-17096418 ] Apache Spark commented on SPARK-31500: -- User 'planga82' has created a pull request

[jira] [Assigned] (SPARK-31616) Add partition event listener in ExternalCatalogWithListener

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31616: Assignee: (was: Apache Spark) > Add partition event listener in ExternalCatalogWithLi

[jira] [Commented] (SPARK-31616) Add partition event listener in ExternalCatalogWithListener

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096406#comment-17096406 ] Apache Spark commented on SPARK-31616: -- User 'wankunde' has created a pull request

[jira] [Assigned] (SPARK-31616) Add partition event listener in ExternalCatalogWithListener

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31616: Assignee: Apache Spark > Add partition event listener in ExternalCatalogWithListener > --

[jira] [Commented] (SPARK-31606) reduce the perf regression of vectorized parquet reader caused by datetime rebase

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096402#comment-17096402 ] Apache Spark commented on SPARK-31606: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-31606) reduce the perf regression of vectorized parquet reader caused by datetime rebase

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31606: Assignee: Wenchen Fan (was: Apache Spark) > reduce the perf regression of vectorized par

[jira] [Commented] (SPARK-31606) reduce the perf regression of vectorized parquet reader caused by datetime rebase

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096400#comment-17096400 ] Apache Spark commented on SPARK-31606: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-31606) reduce the perf regression of vectorized parquet reader caused by datetime rebase

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31606: Assignee: Apache Spark (was: Wenchen Fan) > reduce the perf regression of vectorized par

[jira] [Created] (SPARK-31616) Add partition event listener in ExternalCatalogWithListener

2020-04-30 Thread Wan Kun (Jira)
Wan Kun created SPARK-31616: --- Summary: Add partition event listener in ExternalCatalogWithListener Key: SPARK-31616 URL: https://issues.apache.org/jira/browse/SPARK-31616 Project: Spark Issue Type

[jira] [Commented] (SPARK-30332) When running sql query with limit catalyst throw StackOverFlow exception

2020-04-30 Thread Izek Greenfield (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096340#comment-17096340 ] Izek Greenfield commented on SPARK-30332: - Can someone check that? > When runni

[jira] [Commented] (SPARK-28806) Document SHOW COLUMNS in SQL Reference.

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096313#comment-17096313 ] Apache Spark commented on SPARK-28806: -- User 'gatorsmile' has created a pull reques

[jira] [Assigned] (SPARK-31615) Pretty string output for sql method of RuntimeReplaceable expressions

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31615: Assignee: Apache Spark > Pretty string output for sql method of RuntimeReplaceable expres

[jira] [Commented] (SPARK-31615) Pretty string output for sql method of RuntimeReplaceable expressions

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096288#comment-17096288 ] Apache Spark commented on SPARK-31615: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-31615) Pretty string output for sql method of RuntimeReplaceable expressions

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31615: Assignee: (was: Apache Spark) > Pretty string output for sql method of RuntimeReplace

[jira] [Commented] (SPARK-31615) Pretty string output for sql method of RuntimeReplaceable expressions

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096289#comment-17096289 ] Apache Spark commented on SPARK-31615: -- User 'yaooqinn' has created a pull request

[jira] [Commented] (SPARK-24281) Option to disable Spark UI's web filter in YARN-client mode

2020-04-30 Thread Mickey Shnaiderman (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096269#comment-17096269 ] Mickey Shnaiderman commented on SPARK-24281: Does there exist such a workaro

[jira] [Created] (SPARK-31615) Pretty string output for sql method of RuntimeReplaceable expressions

2020-04-30 Thread Kent Yao (Jira)
Kent Yao created SPARK-31615: Summary: Pretty string output for sql method of RuntimeReplaceable expressions Key: SPARK-31615 URL: https://issues.apache.org/jira/browse/SPARK-31615 Project: Spark

<    1   2   3   4