[
https://issues.apache.org/jira/browse/SPARK-28196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28196:
Assignee: Apache Spark
> Add a new `listTables` and `listLocalTempViews` APIs for
[
https://issues.apache.org/jira/browse/SPARK-28196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28196:
Assignee: (was: Apache Spark)
> Add a new `listTables` and `listLocalTempViews` APIs
[
https://issues.apache.org/jira/browse/SPARK-28196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28196:
Description:
{code:scala}
def listTables(db: String, pattern: String, includeLocalTempViews:
[
https://issues.apache.org/jira/browse/SPARK-28196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28196:
Summary: Add a new `listTables` and `listLocalTempViews` APIs for
SessionCatalog (was:
Yuming Wang created SPARK-28196:
---
Summary: SessionCatalog#listTables support does not list local
temporary views
Key: SPARK-28196
URL: https://issues.apache.org/jira/browse/SPARK-28196
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28133:
Assignee: Apache Spark
> Hyperbolic Functions
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-28133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28133:
Assignee: (was: Apache Spark)
> Hyperbolic Functions
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-17398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
bianqi updated SPARK-17398:
---
Attachment: screenshot-1.png
> Failed to query on external JSon Partitioned table
>
[
https://issues.apache.org/jira/browse/SPARK-17398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874652#comment-16874652
]
bianqi commented on SPARK-17398:
!screenshot-1.png!
> Failed to query on external JSon Partitioned
[
https://issues.apache.org/jira/browse/SPARK-28194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28194:
Assignee: Apache Spark
> [SQL] A NoSuchElementException maybe thrown when
[
https://issues.apache.org/jira/browse/SPARK-28194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28194:
Assignee: (was: Apache Spark)
> [SQL] A NoSuchElementException maybe thrown when
[
https://issues.apache.org/jira/browse/SPARK-28195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liupengcheng updated SPARK-28195:
-
Description:
Currently, we encountered an issue when executing
liupengcheng created SPARK-28195:
Summary: CheckAnalysis not working for Command and report
misleading error message
Key: SPARK-28195
URL: https://issues.apache.org/jira/browse/SPARK-28195
Project:
[
https://issues.apache.org/jira/browse/SPARK-28194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
feiwang updated SPARK-28194:
Description:
{code:java}
java.util.NoSuchElementException: None.get
at
[
https://issues.apache.org/jira/browse/SPARK-28194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
feiwang updated SPARK-28194:
Summary: [SQL] A NoSuchElementException maybe thrown when EnsureRequirement
(was: a
feiwang created SPARK-28194:
---
Summary: a NoSuchElementException maybe thrown when
EnsureRequirement
Key: SPARK-28194
URL: https://issues.apache.org/jira/browse/SPARK-28194
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-28179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-28179:
Assignee: Yuming Wang
> Avoid hard-coded config: spark.sql.globalTempDatabase
>
[
https://issues.apache.org/jira/browse/SPARK-28179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28179.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24979
[
https://issues.apache.org/jira/browse/SPARK-28193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874597#comment-16874597
]
Hyukjin Kwon commented on SPARK-28193:
--
Seems like Arrow feature was enabled. Can you try it after
[
https://issues.apache.org/jira/browse/SPARK-28188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28188:
Assignee: Apache Spark
> Materialize Dataframe API
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-28188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28188:
Assignee: (was: Apache Spark)
> Materialize Dataframe API
>
[
https://issues.apache.org/jira/browse/SPARK-28187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-28187:
--
Assignee: Marcelo Vanzin
> Add hadoop-cloud module to PR builders
>
[
https://issues.apache.org/jira/browse/SPARK-28187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-28187.
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24987
[
https://issues.apache.org/jira/browse/SPARK-28192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874538#comment-16874538
]
Jungtaek Lim edited comment on SPARK-28192 at 6/27/19 10:07 PM:
I
SUSHMIT ROY created SPARK-28193:
---
Summary: toPandas() not working as expected in Apache Spark 2.4.0
Key: SPARK-28193
URL: https://issues.apache.org/jira/browse/SPARK-28193
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-28192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874538#comment-16874538
]
Jungtaek Lim commented on SPARK-28192:
--
I realized new DSv2 (maybe old DSv2 too?) requires
[
https://issues.apache.org/jira/browse/SPARK-28191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28191:
Assignee: (was: Apache Spark)
> Data Source - State - Read side
>
[
https://issues.apache.org/jira/browse/SPARK-28191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28191:
Assignee: Apache Spark
> Data Source - State - Read side
>
[
https://issues.apache.org/jira/browse/SPARK-27959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27959:
Assignee: (was: Apache Spark)
> Change YARN resource configs to use .amount
>
[
https://issues.apache.org/jira/browse/SPARK-27959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27959:
Assignee: Apache Spark
> Change YARN resource configs to use .amount
>
Jungtaek Lim created SPARK-28192:
Summary: Data Source - State - Write side
Key: SPARK-28192
URL: https://issues.apache.org/jira/browse/SPARK-28192
Project: Spark
Issue Type: Sub-task
Jungtaek Lim created SPARK-28191:
Summary: Data Source - State - Read side
Key: SPARK-28191
URL: https://issues.apache.org/jira/browse/SPARK-28191
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-28190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874522#comment-16874522
]
Jungtaek Lim commented on SPARK-28190:
--
While I'll create couple of sub-issues soon, please also
Jungtaek Lim created SPARK-28190:
Summary: Data Source - State
Key: SPARK-28190
URL: https://issues.apache.org/jira/browse/SPARK-28190
Project: Spark
Issue Type: Umbrella
[
https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-26985:
Labels: BigEndian correctness (was: BigEndian)
> Test "access only some column of the all of columns "
[
https://issues.apache.org/jira/browse/SPARK-28189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Luke updated SPARK-28189:
-
Description:
Column names in general are case insensitive in Pyspark, and df.drop() in
general is also case
[
https://issues.apache.org/jira/browse/SPARK-28189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Luke updated SPARK-28189:
-
Description:
Column names in general are case insensitive in Pyspark, and df.drop() in
general is also case
[
https://issues.apache.org/jira/browse/SPARK-28189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Luke updated SPARK-28189:
-
Description:
Column names in general are case insensitive in Pyspark, and df.drop() in
general is also case
[
https://issues.apache.org/jira/browse/SPARK-28189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Luke updated SPARK-28189:
-
Description:
Column names in general are case insensitive in Pyspark, and df.drop() in
general is also case
[
https://issues.apache.org/jira/browse/SPARK-28189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Luke updated SPARK-28189:
-
Summary: Pyspark - df.drop() is Case Sensitive when Referring to Upstream
Tables (was: Pyspark - df.drop is
[
https://issues.apache.org/jira/browse/SPARK-28189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Luke updated SPARK-28189:
-
Description:
Column names in general are case insensitive in Pyspark, and df.drop() in
general is also case
Luke created SPARK-28189:
Summary: Pyspark - df.drop is Case Sensitive when Referring to
Upstream Tables
Key: SPARK-28189
URL: https://issues.apache.org/jira/browse/SPARK-28189
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-28150.
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24955
[
https://issues.apache.org/jira/browse/SPARK-28150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-28150:
--
Assignee: Marcelo Vanzin
> Failure to create multiple contexts in same JVM with
[
https://issues.apache.org/jira/browse/SPARK-27871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-27871.
-
Resolution: Fixed
Fix Version/s: 3.0.0
> LambdaVariable should use per-query unique IDs instead
Vinitha Reddy Gankidi created SPARK-28188:
-
Summary: Materialize Dataframe API
Key: SPARK-28188
URL: https://issues.apache.org/jira/browse/SPARK-28188
Project: Spark
Issue Type: New
[
https://issues.apache.org/jira/browse/SPARK-28157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
DB Tsai updated SPARK-28157:
Fix Version/s: 2.4.4
2.3.4
> Make SHS clear KVStore LogInfo for the blacklisted
[
https://issues.apache.org/jira/browse/SPARK-28187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28187:
Assignee: Apache Spark
> Add hadoop-cloud module to PR builders
>
[
https://issues.apache.org/jira/browse/SPARK-28187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28187:
Assignee: (was: Apache Spark)
> Add hadoop-cloud module to PR builders
>
Marcelo Vanzin created SPARK-28187:
--
Summary: Add hadoop-cloud module to PR builders
Key: SPARK-28187
URL: https://issues.apache.org/jira/browse/SPARK-28187
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-27466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874292#comment-16874292
]
Bruce Robbins commented on SPARK-27466:
---
Hi [~hvanhovell] and/or [~yhuai], any comment on my
[
https://issues.apache.org/jira/browse/SPARK-28174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-28174.
---
Resolution: Fixed
Assignee: Dongjoon Hyun
Fix Version/s: 3.0.0
This is
Alex Kushnir created SPARK-28186:
Summary: array_contains returns null instead of false when one of
the items in the array is null
Key: SPARK-28186
URL: https://issues.apache.org/jira/browse/SPARK-28186
[
https://issues.apache.org/jira/browse/SPARK-28186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alex Kushnir updated SPARK-28186:
-
Description:
If array of items contains a null item then array_contains returns true if item
[
https://issues.apache.org/jira/browse/SPARK-28185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28185:
Assignee: Apache Spark
> Trigger pandas iterator UDF closing stuff when iterator stop
[
https://issues.apache.org/jira/browse/SPARK-28185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28185:
Assignee: (was: Apache Spark)
> Trigger pandas iterator UDF closing stuff when
Weichen Xu created SPARK-28185:
--
Summary: Trigger pandas iterator UDF closing stuff when iterator
stop early
Key: SPARK-28185
URL: https://issues.apache.org/jira/browse/SPARK-28185
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28184:
Assignee: Apache Spark
> Avoid creating new sessions in SparkMetadataOperationSuite
>
[
https://issues.apache.org/jira/browse/SPARK-28184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28184:
Assignee: (was: Apache Spark)
> Avoid creating new sessions in
[
https://issues.apache.org/jira/browse/SPARK-28183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28183:
Assignee: Apache Spark
> Add a task status filter for taskList in REST API
>
[
https://issues.apache.org/jira/browse/SPARK-28183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28183:
Assignee: (was: Apache Spark)
> Add a task status filter for taskList in REST API
>
[
https://issues.apache.org/jira/browse/SPARK-28184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28184:
Summary: Avoid creating new sessions in SparkMetadataOperationSuite (was:
Avoid create new
Yuming Wang created SPARK-28184:
---
Summary: Avoid create new session in SparkMetadataOperationSuite
Key: SPARK-28184
URL: https://issues.apache.org/jira/browse/SPARK-28184
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-28183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lantao Jin updated SPARK-28183:
---
Description:
We have a scenario that our application needs to query failed tasks by REST API
Lantao Jin created SPARK-28183:
--
Summary: Add a task status filter for taskList in REST API
Key: SPARK-28183
URL: https://issues.apache.org/jira/browse/SPARK-28183
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27714:
Assignee: (was: Apache Spark)
> Support Join Reorder based on Genetic Algorithm when
[
https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27714:
Assignee: Apache Spark
> Support Join Reorder based on Genetic Algorithm when the # of
[
https://issues.apache.org/jira/browse/SPARK-28182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874029#comment-16874029
]
Emlyn Corrin commented on SPARK-28182:
--
I can work around it by adding --packages
Emlyn Corrin created SPARK-28182:
Summary: Spark fails to download Hive 2.2+ jars from maven
Key: SPARK-28182
URL: https://issues.apache.org/jira/browse/SPARK-28182
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-23179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-23179:
Summary: Support option to throw exception if overflow occurs during
Decimal arithmetic (was:
[
https://issues.apache.org/jira/browse/SPARK-23179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-23179.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 20350
[
https://issues.apache.org/jira/browse/SPARK-23179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-23179:
---
Assignee: Marco Gaido
> Support option to throw exception if overflow occurs
>
[
https://issues.apache.org/jira/browse/SPARK-28181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28181:
Assignee: Apache Spark
> Add a filter interface to KVStore to speed up the entities
[
https://issues.apache.org/jira/browse/SPARK-28181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28181:
Assignee: (was: Apache Spark)
> Add a filter interface to KVStore to speed up the
Lantao Jin created SPARK-28181:
--
Summary: Add a filter interface to KVStore to speed up the
entities retrieve
Key: SPARK-28181
URL: https://issues.apache.org/jira/browse/SPARK-28181
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873905#comment-16873905
]
Stavros Kontopoulos commented on SPARK-24417:
-
How about transitive deps? Dont they need to
[
https://issues.apache.org/jira/browse/SPARK-28178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28178:
Assignee: (was: Apache Spark)
> DataSourceV2: DataFrameWriter.insertInfo
>
[
https://issues.apache.org/jira/browse/SPARK-28178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-28178:
Assignee: Apache Spark
> DataSourceV2: DataFrameWriter.insertInfo
>
[
https://issues.apache.org/jira/browse/SPARK-28180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
M. Le Bihan updated SPARK-28180:
Description:
I am converting an _RDD_ spark program to a _Dataset_ one.
Once, it was converting a
[
https://issues.apache.org/jira/browse/SPARK-28180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
M. Le Bihan updated SPARK-28180:
Description:
I am converting an _RDD_ spark program to a _Dataset_ one.
Once, it was converting a
[
https://issues.apache.org/jira/browse/SPARK-28180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
M. Le Bihan updated SPARK-28180:
Description:
I am converting an _RDD_ spark program to a _Dataset_ one.
Once, it was converting a
M. Le Bihan created SPARK-28180:
---
Summary: Encoding CSV to Pojo works with Encoders.bean on RDD but
fail on asserts when attemtping it from a Dataset
Key: SPARK-28180
URL:
82 matches
Mail list logo