[jira] [Created] (SPARK-31122) Add support for sparse matrix multiplication

2020-03-11 Thread Alex Favaro (Jira)
Alex Favaro created SPARK-31122: --- Summary: Add support for sparse matrix multiplication Key: SPARK-31122 URL: https://issues.apache.org/jira/browse/SPARK-31122 Project: Spark Issue Type: New Fe

[jira] [Updated] (SPARK-28139) DataSourceV2: Add AlterTable v2 implementation

2020-03-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-28139: Parent Issue: SPARK-31121 (was: SPARK-22386) > DataSourceV2: Add AlterTable v2 implementation > -

[jira] [Updated] (SPARK-31121) Spark API for Table Metadata

2020-03-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31121: Description: Details please see the SPIP doc: https://docs.google.com/document/d/1zLFiA1VuaWeVxeT

[jira] [Updated] (SPARK-28319) DataSourceV2: Support SHOW TABLES

2020-03-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-28319: Parent Issue: SPARK-31121 (was: SPARK-22386) > DataSourceV2: Support SHOW TABLES > --

[jira] [Updated] (SPARK-27857) DataSourceV2: Support ALTER TABLE statements in catalyst SQL parser

2020-03-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-27857: Parent Issue: SPARK-31121 (was: SPARK-22386) > DataSourceV2: Support ALTER TABLE statements in ca

[jira] [Updated] (SPARK-29734) DataSourceV2: Support SHOW CURRENT NAMESPACE

2020-03-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-29734: Parent Issue: SPARK-31121 (was: SPARK-22386) > DataSourceV2: Support SHOW CURRENT NAMESPACE > ---

[jira] [Updated] (SPARK-30352) DataSourceV2: Add CURRENT_CATALOG function

2020-03-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-30352: Parent Issue: SPARK-31121 (was: SPARK-22386) > DataSourceV2: Add CURRENT_CATALOG function > -

[jira] [Updated] (SPARK-28856) DataSourceV2: Support SHOW DATABASES

2020-03-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-28856: Parent Issue: SPARK-31121 (was: SPARK-22386) > DataSourceV2: Support SHOW DATABASES > ---

[jira] [Updated] (SPARK-29609) DataSourceV2: Support DROP NAMESPACE

2020-03-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-29609: Parent Issue: SPARK-31121 (was: SPARK-22386) > DataSourceV2: Support DROP NAMESPACE > ---

[jira] [Updated] (SPARK-29039) centralize the catalog and table lookup logic

2020-03-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-29039: Parent: SPARK-31121 Issue Type: Sub-task (was: Improvement) > centralize the catalog and

[jira] [Updated] (SPARK-29511) DataSourceV2: Support CREATE NAMESPACE

2020-03-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-29511: Parent Issue: SPARK-31121 (was: SPARK-22386) > DataSourceV2: Support CREATE NAMESPACE > -

[jira] [Updated] (SPARK-28341) create a public API for V2SessionCatalog

2020-03-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-28341: Parent: SPARK-31121 Issue Type: Sub-task (was: Improvement) > create a public API for V2S

[jira] [Updated] (SPARK-27661) Add SupportsNamespaces interface for v2 catalogs

2020-03-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-27661: Parent: SPARK-31121 Issue Type: Sub-task (was: Improvement) > Add SupportsNamespaces inte

[jira] [Updated] (SPARK-24252) DataSourceV2: Add catalog support

2020-03-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-24252: Parent Issue: SPARK-31121 (was: SPARK-22386) > DataSourceV2: Add catalog support > --

[jira] [Resolved] (SPARK-31121) Spark API for Table Metadata

2020-03-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31121. - Fix Version/s: 3.0.0 Resolution: Fixed > Spark API for Table Metadata > -

[jira] [Created] (SPARK-31121) Spark API for Table Metadata

2020-03-11 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-31121: --- Summary: Spark API for Table Metadata Key: SPARK-31121 URL: https://issues.apache.org/jira/browse/SPARK-31121 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-31120) Support enabling maven profiles for importing via sbt on Intellij IDEA.

2020-03-11 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-31120: Summary: Support enabling maven profiles for importing via sbt on Intellij IDEA. (was: Su

[jira] [Commented] (SPARK-31039) Unable to use vendor specific datatypes with JDBC (MSSQL)

2020-03-11 Thread Frank Oosterhuis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056863#comment-17056863 ] Frank Oosterhuis commented on SPARK-31039: -- [~hyukjin.kwon]: I'm not sure I agr

[jira] [Updated] (SPARK-31120) Support enabling maven profiles while importing via sbt on Intellij IDEA.

2020-03-11 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-31120: Attachment: Screenshot 2020-03-11 at 4.18.09 PM.png > Support enabling maven profiles whil

[jira] [Updated] (SPARK-31120) Support enabling maven profiles while importing via sbt on Intellij IDEA.

2020-03-11 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-31120: Attachment: Screenshot 2020-03-11 at 4.09.57 PM.png > Support enabling maven profiles whil

[jira] [Created] (SPARK-31120) Support enabling maven profiles while importing via sbt on Intellij IDEA.

2020-03-11 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-31120: --- Summary: Support enabling maven profiles while importing via sbt on Intellij IDEA. Key: SPARK-31120 URL: https://issues.apache.org/jira/browse/SPARK-31120 Proje

[jira] [Resolved] (SPARK-31071) Spark Encoders.bean() should allow marking non-null fields in its Spark schema

2020-03-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31071. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27851 [https://gith

[jira] [Assigned] (SPARK-31071) Spark Encoders.bean() should allow marking non-null fields in its Spark schema

2020-03-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31071: --- Assignee: L. C. Hsieh > Spark Encoders.bean() should allow marking non-null fields in its S

[jira] [Commented] (SPARK-30541) Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite

2020-03-11 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056820#comment-17056820 ] Gabor Somogyi commented on SPARK-30541: --- The first problem is obvious, Kafka is no

[jira] [Updated] (SPARK-31119) Add interval value support for extract expression as source

2020-03-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-31119: - Issue Type: Improvement (was: Bug) > Add interval value support for extract expression as source >

[jira] [Created] (SPARK-31119) Add interval value support for extract expression as source

2020-03-11 Thread Kent Yao (Jira)
Kent Yao created SPARK-31119: Summary: Add interval value support for extract expression as source Key: SPARK-31119 URL: https://issues.apache.org/jira/browse/SPARK-31119 Project: Spark Issue Ty

[jira] [Created] (SPARK-31118) Add version information to the configuration of K8S

2020-03-11 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-31118: -- Summary: Add version information to the configuration of K8S Key: SPARK-31118 URL: https://issues.apache.org/jira/browse/SPARK-31118 Project: Spark Issue Type: S

[jira] [Updated] (SPARK-31114) Constraints inferred from inequality constraints(phase 2)

2020-03-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-31114: Issue Type: Improvement (was: Bug) > Constraints inferred from inequality constraints(phase 2) >

[jira] [Comment Edited] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2020-03-11 Thread Saeed Hassanvand (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056710#comment-17056710 ] Saeed Hassanvand edited comment on SPARK-8333 at 3/11/20, 7:35 AM:

[jira] [Updated] (SPARK-31114) Constraints inferred from inequality constraints(phase 2)

2020-03-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-31114: Summary: Constraints inferred from inequality constraints(phase 2) (was: isNotNull should be infe

[jira] [Created] (SPARK-31117) reduce the test time of DateTimeUtilsSuite

2020-03-11 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-31117: --- Summary: reduce the test time of DateTimeUtilsSuite Key: SPARK-31117 URL: https://issues.apache.org/jira/browse/SPARK-31117 Project: Spark Issue Type: Test

[jira] [Comment Edited] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2020-03-11 Thread Saeed Hassanvand (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056710#comment-17056710 ] Saeed Hassanvand edited comment on SPARK-8333 at 3/11/20, 7:25 AM:

[jira] [Updated] (SPARK-31116) PrquetRowConverter does not follow case sensitivity

2020-03-11 Thread Tae-kyeom, Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tae-kyeom, Kim updated SPARK-31116: --- Priority: Blocker (was: Major) > PrquetRowConverter does not follow case sensitivity >

[jira] [Comment Edited] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2020-03-11 Thread Saeed Hassanvand (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056710#comment-17056710 ] Saeed Hassanvand edited comment on SPARK-8333 at 3/11/20, 7:21 AM:

[jira] [Comment Edited] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2020-03-11 Thread Saeed Hassanvand (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056710#comment-17056710 ] Saeed Hassanvand edited comment on SPARK-8333 at 3/11/20, 7:20 AM:

[jira] [Comment Edited] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2020-03-11 Thread Saeed Hassanvand (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056710#comment-17056710 ] Saeed Hassanvand edited comment on SPARK-8333 at 3/11/20, 7:20 AM:

[jira] [Comment Edited] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2020-03-11 Thread Saeed Hassanvand (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056710#comment-17056710 ] Saeed Hassanvand edited comment on SPARK-8333 at 3/11/20, 7:19 AM:

[jira] [Comment Edited] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2020-03-11 Thread Saeed Hassanvand (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056710#comment-17056710 ] Saeed Hassanvand edited comment on SPARK-8333 at 3/11/20, 7:17 AM:

[jira] [Created] (SPARK-31116) PrquetRowConverter does not follow case sensitivity

2020-03-11 Thread Tae-kyeom, Kim (Jira)
Tae-kyeom, Kim created SPARK-31116: -- Summary: PrquetRowConverter does not follow case sensitivity Key: SPARK-31116 URL: https://issues.apache.org/jira/browse/SPARK-31116 Project: Spark Issue

[jira] [Comment Edited] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2020-03-11 Thread Saeed Hassanvand (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056710#comment-17056710 ] Saeed Hassanvand edited comment on SPARK-8333 at 3/11/20, 7:16 AM:

[jira] [Comment Edited] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2020-03-11 Thread Saeed Hassanvand (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056710#comment-17056710 ] Saeed Hassanvand edited comment on SPARK-8333 at 3/11/20, 7:15 AM:

[jira] [Comment Edited] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2020-03-11 Thread Saeed Hassanvand (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056710#comment-17056710 ] Saeed Hassanvand edited comment on SPARK-8333 at 3/11/20, 7:14 AM:

[jira] [Commented] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2020-03-11 Thread Saeed Hassanvand (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056710#comment-17056710 ] Saeed Hassanvand commented on SPARK-8333: - Hi, Its seems that this bug still exi

[jira] [Created] (SPARK-31115) Lots of columns and distinct aggregation functions triggers compile exception on Janino

2020-03-11 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-31115: Summary: Lots of columns and distinct aggregation functions triggers compile exception on Janino Key: SPARK-31115 URL: https://issues.apache.org/jira/browse/SPARK-31115

<    1   2