[jira] [Assigned] (SPARK-28196) Add a new `listTables` and `listLocalTempViews` APIs for SessionCatalog

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28196: Assignee: Apache Spark > Add a new `listTables` and `listLocalTempViews` APIs for

[jira] [Assigned] (SPARK-28196) Add a new `listTables` and `listLocalTempViews` APIs for SessionCatalog

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28196: Assignee: (was: Apache Spark) > Add a new `listTables` and `listLocalTempViews` APIs

[jira] [Updated] (SPARK-28196) Add a new `listTables` and `listLocalTempViews` APIs for SessionCatalog

2019-06-27 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28196: Description:   {code:scala} def listTables(db: String, pattern: String, includeLocalTempViews:

[jira] [Updated] (SPARK-28196) Add a new `listTables` and `listLocalTempViews` APIs for SessionCatalog

2019-06-27 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28196: Summary: Add a new `listTables` and `listLocalTempViews` APIs for SessionCatalog (was:

[jira] [Created] (SPARK-28196) SessionCatalog#listTables support does not list local temporary views

2019-06-27 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28196: --- Summary: SessionCatalog#listTables support does not list local temporary views Key: SPARK-28196 URL: https://issues.apache.org/jira/browse/SPARK-28196 Project: Spark

[jira] [Assigned] (SPARK-28133) Hyperbolic Functions

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28133: Assignee: Apache Spark > Hyperbolic Functions > > >

[jira] [Assigned] (SPARK-28133) Hyperbolic Functions

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28133: Assignee: (was: Apache Spark) > Hyperbolic Functions > > >

[jira] [Updated] (SPARK-17398) Failed to query on external JSon Partitioned table

2019-06-27 Thread bianqi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated SPARK-17398: --- Attachment: screenshot-1.png > Failed to query on external JSon Partitioned table >

[jira] [Commented] (SPARK-17398) Failed to query on external JSon Partitioned table

2019-06-27 Thread bianqi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874652#comment-16874652 ] bianqi commented on SPARK-17398: !screenshot-1.png! > Failed to query on external JSon Partitioned

[jira] [Assigned] (SPARK-28194) [SQL] A NoSuchElementException maybe thrown when EnsureRequirement

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28194: Assignee: Apache Spark > [SQL] A NoSuchElementException maybe thrown when

[jira] [Assigned] (SPARK-28194) [SQL] A NoSuchElementException maybe thrown when EnsureRequirement

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28194: Assignee: (was: Apache Spark) > [SQL] A NoSuchElementException maybe thrown when

[jira] [Updated] (SPARK-28195) CheckAnalysis not working for Command and report misleading error message

2019-06-27 Thread liupengcheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liupengcheng updated SPARK-28195: - Description: Currently, we encountered an issue when executing

[jira] [Created] (SPARK-28195) CheckAnalysis not working for Command and report misleading error message

2019-06-27 Thread liupengcheng (JIRA)
liupengcheng created SPARK-28195: Summary: CheckAnalysis not working for Command and report misleading error message Key: SPARK-28195 URL: https://issues.apache.org/jira/browse/SPARK-28195 Project:

[jira] [Updated] (SPARK-28194) [SQL] A NoSuchElementException maybe thrown when EnsureRequirement

2019-06-27 Thread feiwang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-28194: Description: {code:java} java.util.NoSuchElementException: None.get at

[jira] [Updated] (SPARK-28194) [SQL] A NoSuchElementException maybe thrown when EnsureRequirement

2019-06-27 Thread feiwang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-28194: Summary: [SQL] A NoSuchElementException maybe thrown when EnsureRequirement (was: a

[jira] [Created] (SPARK-28194) a NoSuchElementException maybe thrown when EnsureRequirement

2019-06-27 Thread feiwang (JIRA)
feiwang created SPARK-28194: --- Summary: a NoSuchElementException maybe thrown when EnsureRequirement Key: SPARK-28194 URL: https://issues.apache.org/jira/browse/SPARK-28194 Project: Spark Issue

[jira] [Assigned] (SPARK-28179) Avoid hard-coded config: spark.sql.globalTempDatabase

2019-06-27 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28179: Assignee: Yuming Wang > Avoid hard-coded config: spark.sql.globalTempDatabase >

[jira] [Resolved] (SPARK-28179) Avoid hard-coded config: spark.sql.globalTempDatabase

2019-06-27 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28179. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24979

[jira] [Commented] (SPARK-28193) toPandas() not working as expected in Apache Spark 2.4.0

2019-06-27 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874597#comment-16874597 ] Hyukjin Kwon commented on SPARK-28193: -- Seems like Arrow feature was enabled. Can you try it after

[jira] [Assigned] (SPARK-28188) Materialize Dataframe API

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28188: Assignee: Apache Spark > Materialize Dataframe API > -- > >

[jira] [Assigned] (SPARK-28188) Materialize Dataframe API

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28188: Assignee: (was: Apache Spark) > Materialize Dataframe API >

[jira] [Assigned] (SPARK-28187) Add hadoop-cloud module to PR builders

2019-06-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28187: -- Assignee: Marcelo Vanzin > Add hadoop-cloud module to PR builders >

[jira] [Resolved] (SPARK-28187) Add hadoop-cloud module to PR builders

2019-06-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28187. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24987

[jira] [Comment Edited] (SPARK-28192) Data Source - State - Write side

2019-06-27 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874538#comment-16874538 ] Jungtaek Lim edited comment on SPARK-28192 at 6/27/19 10:07 PM: I

[jira] [Created] (SPARK-28193) toPandas() not working as expected in Apache Spark 2.4.0

2019-06-27 Thread SUSHMIT ROY (JIRA)
SUSHMIT ROY created SPARK-28193: --- Summary: toPandas() not working as expected in Apache Spark 2.4.0 Key: SPARK-28193 URL: https://issues.apache.org/jira/browse/SPARK-28193 Project: Spark Issue

[jira] [Commented] (SPARK-28192) Data Source - State - Write side

2019-06-27 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874538#comment-16874538 ] Jungtaek Lim commented on SPARK-28192: -- I realized new DSv2 (maybe old DSv2 too?) requires

[jira] [Assigned] (SPARK-28191) Data Source - State - Read side

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28191: Assignee: (was: Apache Spark) > Data Source - State - Read side >

[jira] [Assigned] (SPARK-28191) Data Source - State - Read side

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28191: Assignee: Apache Spark > Data Source - State - Read side >

[jira] [Assigned] (SPARK-27959) Change YARN resource configs to use .amount

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27959: Assignee: (was: Apache Spark) > Change YARN resource configs to use .amount >

[jira] [Assigned] (SPARK-27959) Change YARN resource configs to use .amount

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27959: Assignee: Apache Spark > Change YARN resource configs to use .amount >

[jira] [Created] (SPARK-28192) Data Source - State - Write side

2019-06-27 Thread Jungtaek Lim (JIRA)
Jungtaek Lim created SPARK-28192: Summary: Data Source - State - Write side Key: SPARK-28192 URL: https://issues.apache.org/jira/browse/SPARK-28192 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-28191) Data Source - State - Read side

2019-06-27 Thread Jungtaek Lim (JIRA)
Jungtaek Lim created SPARK-28191: Summary: Data Source - State - Read side Key: SPARK-28191 URL: https://issues.apache.org/jira/browse/SPARK-28191 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-28190) Data Source - State

2019-06-27 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874522#comment-16874522 ] Jungtaek Lim commented on SPARK-28190: -- While I'll create couple of sub-issues soon, please also

[jira] [Created] (SPARK-28190) Data Source - State

2019-06-27 Thread Jungtaek Lim (JIRA)
Jungtaek Lim created SPARK-28190: Summary: Data Source - State Key: SPARK-28190 URL: https://issues.apache.org/jira/browse/SPARK-28190 Project: Spark Issue Type: Umbrella

[jira] [Updated] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

2019-06-27 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-26985: Labels: BigEndian correctness (was: BigEndian) > Test "access only some column of the all of columns "

[jira] [Updated] (SPARK-28189) Pyspark - df.drop() is Case Sensitive when Referring to Upstream Tables

2019-06-27 Thread Luke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke updated SPARK-28189: - Description: Column names in general are case insensitive in Pyspark, and df.drop() in general is also case

[jira] [Updated] (SPARK-28189) Pyspark - df.drop() is Case Sensitive when Referring to Upstream Tables

2019-06-27 Thread Luke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke updated SPARK-28189: - Description: Column names in general are case insensitive in Pyspark, and df.drop() in general is also case

[jira] [Updated] (SPARK-28189) Pyspark - df.drop() is Case Sensitive when Referring to Upstream Tables

2019-06-27 Thread Luke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke updated SPARK-28189: - Description: Column names in general are case insensitive in Pyspark, and df.drop() in general is also case

[jira] [Updated] (SPARK-28189) Pyspark - df.drop() is Case Sensitive when Referring to Upstream Tables

2019-06-27 Thread Luke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke updated SPARK-28189: - Description: Column names in general are case insensitive in Pyspark, and df.drop() in general is also case

[jira] [Updated] (SPARK-28189) Pyspark - df.drop() is Case Sensitive when Referring to Upstream Tables

2019-06-27 Thread Luke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke updated SPARK-28189: - Summary: Pyspark - df.drop() is Case Sensitive when Referring to Upstream Tables (was: Pyspark - df.drop is

[jira] [Updated] (SPARK-28189) Pyspark - df.drop() is Case Sensitive when Referring to Upstream Tables

2019-06-27 Thread Luke (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke updated SPARK-28189: - Description: Column names in general are case insensitive in Pyspark, and df.drop() in general is also case

[jira] [Created] (SPARK-28189) Pyspark - df.drop is Case Sensitive when Referring to Upstream Tables

2019-06-27 Thread Luke (JIRA)
Luke created SPARK-28189: Summary: Pyspark - df.drop is Case Sensitive when Referring to Upstream Tables Key: SPARK-28189 URL: https://issues.apache.org/jira/browse/SPARK-28189 Project: Spark

[jira] [Resolved] (SPARK-28150) Failure to create multiple contexts in same JVM with Kerberos auth

2019-06-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28150. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24955

[jira] [Assigned] (SPARK-28150) Failure to create multiple contexts in same JVM with Kerberos auth

2019-06-27 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28150: -- Assignee: Marcelo Vanzin > Failure to create multiple contexts in same JVM with

[jira] [Resolved] (SPARK-27871) LambdaVariable should use per-query unique IDs instead of globally unique IDs

2019-06-27 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27871. - Resolution: Fixed Fix Version/s: 3.0.0 > LambdaVariable should use per-query unique IDs instead

[jira] [Created] (SPARK-28188) Materialize Dataframe API

2019-06-27 Thread Vinitha Reddy Gankidi (JIRA)
Vinitha Reddy Gankidi created SPARK-28188: - Summary: Materialize Dataframe API Key: SPARK-28188 URL: https://issues.apache.org/jira/browse/SPARK-28188 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-28157) Make SHS clear KVStore LogInfo for the blacklisted entries

2019-06-27 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-28157: Fix Version/s: 2.4.4 2.3.4 > Make SHS clear KVStore LogInfo for the blacklisted

[jira] [Assigned] (SPARK-28187) Add hadoop-cloud module to PR builders

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28187: Assignee: Apache Spark > Add hadoop-cloud module to PR builders >

[jira] [Assigned] (SPARK-28187) Add hadoop-cloud module to PR builders

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28187: Assignee: (was: Apache Spark) > Add hadoop-cloud module to PR builders >

[jira] [Created] (SPARK-28187) Add hadoop-cloud module to PR builders

2019-06-27 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-28187: -- Summary: Add hadoop-cloud module to PR builders Key: SPARK-28187 URL: https://issues.apache.org/jira/browse/SPARK-28187 Project: Spark Issue Type:

[jira] [Commented] (SPARK-27466) LEAD function with 'ROWS BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING' causes exception in Spark

2019-06-27 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874292#comment-16874292 ] Bruce Robbins commented on SPARK-27466: --- Hi [~hvanhovell] and/or [~yhuai], any comment on my

[jira] [Resolved] (SPARK-28174) Upgrade to Kafka 2.3.0

2019-06-27 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28174. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 3.0.0 This is

[jira] [Created] (SPARK-28186) array_contains returns null instead of false when one of the items in the array is null

2019-06-27 Thread Alex Kushnir (JIRA)
Alex Kushnir created SPARK-28186: Summary: array_contains returns null instead of false when one of the items in the array is null Key: SPARK-28186 URL: https://issues.apache.org/jira/browse/SPARK-28186

[jira] [Updated] (SPARK-28186) array_contains returns null instead of false when one of the items in the array is null

2019-06-27 Thread Alex Kushnir (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Kushnir updated SPARK-28186: - Description: If array of items contains a null item then array_contains returns true if item

[jira] [Assigned] (SPARK-28185) Trigger pandas iterator UDF closing stuff when iterator stop early

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28185: Assignee: Apache Spark > Trigger pandas iterator UDF closing stuff when iterator stop

[jira] [Assigned] (SPARK-28185) Trigger pandas iterator UDF closing stuff when iterator stop early

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28185: Assignee: (was: Apache Spark) > Trigger pandas iterator UDF closing stuff when

[jira] [Created] (SPARK-28185) Trigger pandas iterator UDF closing stuff when iterator stop early

2019-06-27 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-28185: -- Summary: Trigger pandas iterator UDF closing stuff when iterator stop early Key: SPARK-28185 URL: https://issues.apache.org/jira/browse/SPARK-28185 Project: Spark

[jira] [Assigned] (SPARK-28184) Avoid creating new sessions in SparkMetadataOperationSuite

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28184: Assignee: Apache Spark > Avoid creating new sessions in SparkMetadataOperationSuite >

[jira] [Assigned] (SPARK-28184) Avoid creating new sessions in SparkMetadataOperationSuite

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28184: Assignee: (was: Apache Spark) > Avoid creating new sessions in

[jira] [Assigned] (SPARK-28183) Add a task status filter for taskList in REST API

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28183: Assignee: Apache Spark > Add a task status filter for taskList in REST API >

[jira] [Assigned] (SPARK-28183) Add a task status filter for taskList in REST API

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28183: Assignee: (was: Apache Spark) > Add a task status filter for taskList in REST API >

[jira] [Updated] (SPARK-28184) Avoid creating new sessions in SparkMetadataOperationSuite

2019-06-27 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28184: Summary: Avoid creating new sessions in SparkMetadataOperationSuite (was: Avoid create new

[jira] [Created] (SPARK-28184) Avoid create new session in SparkMetadataOperationSuite

2019-06-27 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28184: --- Summary: Avoid create new session in SparkMetadataOperationSuite Key: SPARK-28184 URL: https://issues.apache.org/jira/browse/SPARK-28184 Project: Spark Issue

[jira] [Updated] (SPARK-28183) Add a task status filter for taskList in REST API

2019-06-27 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-28183: --- Description: We have a scenario that our application needs to query failed tasks by REST API

[jira] [Created] (SPARK-28183) Add a task status filter for taskList in REST API

2019-06-27 Thread Lantao Jin (JIRA)
Lantao Jin created SPARK-28183: -- Summary: Add a task status filter for taskList in REST API Key: SPARK-28183 URL: https://issues.apache.org/jira/browse/SPARK-28183 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-27714) Support Join Reorder based on Genetic Algorithm when the # of joined tables > 12

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27714: Assignee: (was: Apache Spark) > Support Join Reorder based on Genetic Algorithm when

[jira] [Assigned] (SPARK-27714) Support Join Reorder based on Genetic Algorithm when the # of joined tables > 12

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27714: Assignee: Apache Spark > Support Join Reorder based on Genetic Algorithm when the # of

[jira] [Commented] (SPARK-28182) Spark fails to download Hive 2.2+ jars from maven

2019-06-27 Thread Emlyn Corrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874029#comment-16874029 ] Emlyn Corrin commented on SPARK-28182: -- I can work around it by adding --packages

[jira] [Created] (SPARK-28182) Spark fails to download Hive 2.2+ jars from maven

2019-06-27 Thread Emlyn Corrin (JIRA)
Emlyn Corrin created SPARK-28182: Summary: Spark fails to download Hive 2.2+ jars from maven Key: SPARK-28182 URL: https://issues.apache.org/jira/browse/SPARK-28182 Project: Spark Issue

[jira] [Updated] (SPARK-23179) Support option to throw exception if overflow occurs during Decimal arithmetic

2019-06-27 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-23179: Summary: Support option to throw exception if overflow occurs during Decimal arithmetic (was:

[jira] [Resolved] (SPARK-23179) Support option to throw exception if overflow occurs

2019-06-27 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-23179. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 20350

[jira] [Assigned] (SPARK-23179) Support option to throw exception if overflow occurs

2019-06-27 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-23179: --- Assignee: Marco Gaido > Support option to throw exception if overflow occurs >

[jira] [Assigned] (SPARK-28181) Add a filter interface to KVStore to speed up the entities retrieve

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28181: Assignee: Apache Spark > Add a filter interface to KVStore to speed up the entities

[jira] [Assigned] (SPARK-28181) Add a filter interface to KVStore to speed up the entities retrieve

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28181: Assignee: (was: Apache Spark) > Add a filter interface to KVStore to speed up the

[jira] [Created] (SPARK-28181) Add a filter interface to KVStore to speed up the entities retrieve

2019-06-27 Thread Lantao Jin (JIRA)
Lantao Jin created SPARK-28181: -- Summary: Add a filter interface to KVStore to speed up the entities retrieve Key: SPARK-28181 URL: https://issues.apache.org/jira/browse/SPARK-28181 Project: Spark

[jira] [Commented] (SPARK-24417) Build and Run Spark on JDK11

2019-06-27 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873905#comment-16873905 ] Stavros Kontopoulos commented on SPARK-24417: - How about transitive deps? Dont they need to

[jira] [Assigned] (SPARK-28178) DataSourceV2: DataFrameWriter.insertInfo

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28178: Assignee: (was: Apache Spark) > DataSourceV2: DataFrameWriter.insertInfo >

[jira] [Assigned] (SPARK-28178) DataSourceV2: DataFrameWriter.insertInfo

2019-06-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28178: Assignee: Apache Spark > DataSourceV2: DataFrameWriter.insertInfo >

[jira] [Updated] (SPARK-28180) Encoding CSV to Pojo works with Encoders.bean on RDD but fail on asserts when attemtping it from a Dataset

2019-06-27 Thread M. Le Bihan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] M. Le Bihan updated SPARK-28180: Description: I am converting an _RDD_ spark program to a _Dataset_ one. Once, it was converting a

[jira] [Updated] (SPARK-28180) Encoding CSV to Pojo works with Encoders.bean on RDD but fail on asserts when attemtping it from a Dataset

2019-06-27 Thread M. Le Bihan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] M. Le Bihan updated SPARK-28180: Description: I am converting an _RDD_ spark program to a _Dataset_ one. Once, it was converting a

[jira] [Updated] (SPARK-28180) Encoding CSV to Pojo works with Encoders.bean on RDD but fail on asserts when attemtping it from a Dataset

2019-06-27 Thread M. Le Bihan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] M. Le Bihan updated SPARK-28180: Description: I am converting an _RDD_ spark program to a _Dataset_ one. Once, it was converting a

[jira] [Created] (SPARK-28180) Encoding CSV to Pojo works with Encoders.bean on RDD but fail on asserts when attemtping it from a Dataset

2019-06-27 Thread M. Le Bihan (JIRA)
M. Le Bihan created SPARK-28180: --- Summary: Encoding CSV to Pojo works with Encoders.bean on RDD but fail on asserts when attemtping it from a Dataset Key: SPARK-28180 URL: