[jira] [Updated] (SPARK-29278) Implement CATALOG/NAMESPACE related SQL commands for Data Source V2

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29278: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Implement

[jira] [Commented] (SPARK-29278) Implement CATALOG/NAMESPACE related SQL commands for Data Source V2

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060722#comment-17060722 ] Dongjoon Hyun commented on SPARK-29278: --- Hi, [~imback82]. Could you revise this issue because

[jira] [Commented] (SPARK-29262) DataFrameWriter insertIntoPartition function

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060719#comment-17060719 ] Dongjoon Hyun commented on SPARK-29262: --- Hi, [~hzfeiwang]. Is this JIRA issue still valid? >

[jira] [Updated] (SPARK-29262) DataFrameWriter insertIntoPartition function

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29262: -- Affects Version/s: (was: 3.0.0) 3.1.0 > DataFrameWriter

[jira] [Closed] (SPARK-29479) Design more fluent API for Cypher querying

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-29479. - > Design more fluent API for Cypher querying > -- > >

[jira] [Closed] (SPARK-29480) Ensure that each input row refers to a single relationship type

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-29480. - > Ensure that each input row refers to a single relationship type >

[jira] [Resolved] (SPARK-29480) Ensure that each input row refers to a single relationship type

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29480. --- Resolution: Won't Do Unfortunately, this `Graph` component issue is closed due to the

[jira] [Resolved] (SPARK-29479) Design more fluent API for Cypher querying

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29479. --- Resolution: Won't Do Unfortunately, this `Graph` component issue is closed due to the

[jira] [Updated] (SPARK-30105) Add StreamingQueryListener support to PySpark

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30105: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add StreamingQueryListener

[jira] [Updated] (SPARK-30127) UDF should work for case class like Dataset operations

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30127: -- Affects Version/s: (was: 3.0.0) 3.1.0 > UDF should work for case

[jira] [Updated] (SPARK-30108) Add robust accumulator for observable metrics

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30108: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Add robust accumulator for

[jira] [Updated] (SPARK-30133) Support DELETE Jar and DELETE File functionality in spark

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30133: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support DELETE Jar and

[jira] [Updated] (SPARK-30160) Extend ExecutorPodAllocator for arbitrary CRDs

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30160: -- Affects Version/s: (was: 2.4.4) (was: 3.0.0)

[jira] [Commented] (SPARK-30160) Extend ExecutorPodAllocator for arbitrary CRDs

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060711#comment-17060711 ] Dongjoon Hyun commented on SPARK-30160: --- According to the PR status, I updated the `Affected

[jira] [Updated] (SPARK-30319) Adds a stricter version of as[T]

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30319: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Adds a stricter version of

[jira] [Resolved] (SPARK-30335) Clarify behavior of FIRST and LAST without OVER caluse.

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30335. --- Fix Version/s: 3.1.0 Assignee: Hyukjin Kwon Resolution: Fixed This is

[jira] [Updated] (SPARK-30335) Clarify behavior of FIRST and LAST without OVER caluse.

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30335: -- Component/s: Documentation > Clarify behavior of FIRST and LAST without OVER caluse. >

[jira] [Updated] (SPARK-30335) Clarify behavior of FIRST and LAST without OVER caluse.

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30335: -- Affects Version/s: (was: 2.4.0) (was: 3.0.0)

[jira] [Updated] (SPARK-30517) Support SHOW TABLES EXTENDED

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30517: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support SHOW TABLES

[jira] [Resolved] (SPARK-30545) Impl Extremely Randomized Trees

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30545. --- Assignee: (was: zhengruifeng) Resolution: Won't Do According to the PR

[jira] [Updated] (SPARK-30624) JDBCV2 with catalog functionalities

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30624: -- Affects Version/s: (was: 3.0.0) 3.1.0 > JDBCV2 with catalog

[jira] [Updated] (SPARK-30877) Make Aggregate higher order function with Spark Aggregate Expressions

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30877: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Make Aggregate higher

[jira] [Updated] (SPARK-30920) DSv2 Predicate Framework

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30920: -- Affects Version/s: (was: 3.0.0) 3.1.0 > DSv2 Predicate Framework >

[jira] [Updated] (SPARK-30641) ML algs blockify input vectors

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30641: -- Affects Version/s: (was: 3.0.0) 3.1.0 > ML algs blockify input

[jira] [Updated] (SPARK-31026) Parquet predicate pushdown on columns with dots

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31026: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Parquet predicate pushdown

[jira] [Updated] (SPARK-31113) Support DDL "SHOW VIEWS"

2020-03-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31113: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Support DDL "SHOW VIEWS" >

[jira] [Updated] (SPARK-31134) optimize skew join after shuffle partitions are coalesced

2020-03-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31134: Affects Version/s: (was: 3.1.0) 3.0.0 > optimize skew join after

[jira] [Commented] (SPARK-31134) optimize skew join after shuffle partitions are coalesced

2020-03-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060682#comment-17060682 ] Wenchen Fan commented on SPARK-31134: - This is a code refactor for a new feature in 3.0. I think we

[jira] [Resolved] (SPARK-31134) optimize skew join after shuffle partitions are coalesced

2020-03-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-31134. - Fix Version/s: 3.0.0 Resolution: Fixed > optimize skew join after shuffle partitions are

[jira] [Resolved] (SPARK-30103) Remove duplicate schema merge logic

2020-03-17 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved SPARK-30103. -- Resolution: Won't Fix > Remove duplicate schema merge logic >

[jira] [Commented] (SPARK-31164) Inconsistent rdd and output partitioning for bucket table when output doesn't contain all bucket columns

2020-03-17 Thread Zhenhua Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060670#comment-17060670 ] Zhenhua Wang commented on SPARK-31164: -- ThanksĀ [~dongjoon], I added 2.3.4 and 2.2.3 > Inconsistent

[jira] [Updated] (SPARK-31164) Inconsistent rdd and output partitioning for bucket table when output doesn't contain all bucket columns

2020-03-17 Thread Zhenhua Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-31164: - Affects Version/s: 2.2.3 2.3.4 > Inconsistent rdd and output

<    1   2