[
https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834322#comment-16834322
]
peng bo edited comment on SPARK-27638 at 5/7/19 5:47 AM:
-
[~maxgekk]
I'd love
bettermouse created SPARK-27647:
---
Summary: Metric Gauge not threadsafe
Key: SPARK-27647
URL: https://issues.apache.org/jira/browse/SPARK-27647
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-27643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834333#comment-16834333
]
Yuming Wang commented on SPARK-27643:
-
Do you mean {{spark.sql.hive.metastore.version}}:
[
https://issues.apache.org/jira/browse/SPARK-24935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-24935:
Fix Version/s: 2.3.4
> Problem with Executing Hive UDF's from Spark 2.2 Onwards
>
[
https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peng bo updated SPARK-27638:
Description:
The below example works with both Mysql and Hive, however not with spark.
{code:java}
[
https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834322#comment-16834322
]
peng bo commented on SPARK-27638:
-
[~maxgekk]
I'd love propose a PR for this. However i am in the
[
https://issues.apache.org/jira/browse/SPARK-18406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834276#comment-16834276
]
Apache Spark commented on SPARK-18406:
--
User 'jiangxb1987' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-18406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834277#comment-16834277
]
Apache Spark commented on SPARK-18406:
--
User 'jiangxb1987' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-25139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25139:
Assignee: (was: Apache Spark)
> PythonRunner#WriterThread released block after
[
https://issues.apache.org/jira/browse/SPARK-25139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25139:
Assignee: Apache Spark
> PythonRunner#WriterThread released block after TaskRunner
[
https://issues.apache.org/jira/browse/SPARK-27466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834258#comment-16834258
]
Bruce Robbins commented on SPARK-27466:
---
This _seems_ to be intentional, according to SPARK-8641
[
https://issues.apache.org/jira/browse/SPARK-27646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27646:
Assignee: (was: Apache Spark)
> Required refactoring for bytecode analysis
>
[
https://issues.apache.org/jira/browse/SPARK-27646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27646:
Assignee: Apache Spark
> Required refactoring for bytecode analysis
>
[
https://issues.apache.org/jira/browse/SPARK-27646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
DB Tsai updated SPARK-27646:
Summary: Required refactoring for bytecode analysis (was: Required
refactoring for bytecode analysis
DB Tsai created SPARK-27646:
---
Summary: Required refactoring for bytecode analysis work
Key: SPARK-27646
URL: https://issues.apache.org/jira/browse/SPARK-27646
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834214#comment-16834214
]
Maxim Gekk commented on SPARK-27638:
[~pengbo] Are you going to propose a PR for that? If not, I can
[
https://issues.apache.org/jira/browse/SPARK-26555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834203#comment-16834203
]
Josh Rosen commented on SPARK-26555:
I won't be able to tackle a backport for at least a week, so
Seungmin Lee created SPARK-27645:
Summary: Cache result of count function to that RDD
Key: SPARK-27645
URL: https://issues.apache.org/jira/browse/SPARK-27645
Project: Spark
Issue Type: New
[
https://issues.apache.org/jira/browse/SPARK-27644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27644:
--
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-25556
> Enable
[
https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros updated SPARK-27622:
---
Summary: Avoid network communication when block manager fetches disk
persisted RDD
[
https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros updated SPARK-27622:
---
Summary: Avoid the network when block manager fetches disk persisted RDD
blocks
Dongjoon Hyun created SPARK-27644:
-
Summary: Enable spark.sql.optimizer.nestedSchemaPruning.enabled by
default
Key: SPARK-27644
URL: https://issues.apache.org/jira/browse/SPARK-27644
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831553#comment-16831553
]
Attila Zsolt Piros edited comment on SPARK-27622 at 5/6/19 6:22 PM:
[
https://issues.apache.org/jira/browse/SPARK-26555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834055#comment-16834055
]
Sean Owen commented on SPARK-26555:
---
I personally think it's OK to backport -- do you want to open a
[
https://issues.apache.org/jira/browse/SPARK-26555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834025#comment-16834025
]
Josh Rosen commented on SPARK-26555:
[~cloud_fan] [~srowen], could we backport this to the 2.4.x
[
https://issues.apache.org/jira/browse/SPARK-19335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834024#comment-16834024
]
Darshan commented on SPARK-19335:
-
For some row level access related issue, our organisation allows to
[
https://issues.apache.org/jira/browse/SPARK-23299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Holden Karau resolved SPARK-23299.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Merged a fix for this for 3, we can continue
[
https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833999#comment-16833999
]
Wenchen Fan commented on SPARK-27638:
-
I think it should be changed. When comapring string and int,
[
https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833992#comment-16833992
]
Sean Owen commented on SPARK-27638:
---
Are you saying that's intended behavior or should be changed?
>
[
https://issues.apache.org/jira/browse/SPARK-24935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833982#comment-16833982
]
Wenchen Fan commented on SPARK-24935:
-
I have sent https://github.com/apache/spark/pull/24539 to
[
https://issues.apache.org/jira/browse/SPARK-24935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-24935:
Fix Version/s: (was: 2.4.1)
2.4.3
> Problem with Executing Hive UDF's from
[
https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833957#comment-16833957
]
Maxim Gekk edited comment on SPARK-27638 at 5/6/19 4:10 PM:
It works with
[
https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833957#comment-16833957
]
Maxim Gekk commented on SPARK-27638:
It works with explicit to_date:
{code:scala}
scala> val ds =
[
https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833949#comment-16833949
]
Maxim Gekk edited comment on SPARK-27638 at 5/6/19 3:57 PM:
[~srowen] The
[
https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833949#comment-16833949
]
Maxim Gekk commented on SPARK-27638:
[~srowen] The date literal should be casted to the date type by
[
https://issues.apache.org/jira/browse/SPARK-27642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27642:
Assignee: Wenchen Fan (was: Apache Spark)
> make v1 offset extends v2 offset
>
[
https://issues.apache.org/jira/browse/SPARK-27642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27642:
Assignee: Apache Spark (was: Wenchen Fan)
> make v1 offset extends v2 offset
>
[
https://issues.apache.org/jira/browse/SPARK-26839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833932#comment-16833932
]
Sean Owen commented on SPARK-26839:
---
Right now it seems to be an issue with datanucleus in Hive. If it
[
https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833931#comment-16833931
]
Sean Owen commented on SPARK-27638:
---
CC [~maxgekk] but isn't the issue that your date isn't matching
[
https://issues.apache.org/jira/browse/SPARK-27643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhichao Zhang updated SPARK-27643:
---
Description: Add supported Hive version list for each spark version in doc.
(was: Add
Zhichao Zhang created SPARK-27643:
--
Summary: Add supported Hive version in doc
Key: SPARK-27643
URL: https://issues.apache.org/jira/browse/SPARK-27643
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-27643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhichao Zhang updated SPARK-27643:
---
Summary: Add supported Hive version list in doc (was: Add supported Hive
version in doc)
Wenchen Fan created SPARK-27642:
---
Summary: make v1 offset extends v2 offset
Key: SPARK-27642
URL: https://issues.apache.org/jira/browse/SPARK-27642
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-27641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sergey Zhemzhitsky updated SPARK-27641:
---
Summary: Unregistering a single Metrics Source with no metrics leads to
removing
Sergey Zhemzhitsky created SPARK-27641:
--
Summary: Unregistering a single Metrics Source with no metrics
leads to removing all the from other sources with the same name
Key: SPARK-27641
URL:
[
https://issues.apache.org/jira/browse/SPARK-23887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23887:
Assignee: (was: Apache Spark)
> update query progress
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-23887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23887:
Assignee: Apache Spark
> update query progress
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-27579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-27579.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24471
[
https://issues.apache.org/jira/browse/SPARK-26839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833784#comment-16833784
]
Mihaly Toth commented on SPARK-26839:
-
Hmm, sorry, I overlooked something. I only have
[
https://issues.apache.org/jira/browse/SPARK-26839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833763#comment-16833763
]
Mihaly Toth commented on SPARK-26839:
-
[~srowen], I was facing CNFE and I have a potential fix for
[
https://issues.apache.org/jira/browse/SPARK-27634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833743#comment-16833743
]
Gabor Somogyi edited comment on SPARK-27634 at 5/6/19 12:08 PM:
[
https://issues.apache.org/jira/browse/SPARK-27634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833743#comment-16833743
]
Gabor Somogyi commented on SPARK-27634:
---
[~yuwang0...@gmail.com] I think one should use temporary
[
https://issues.apache.org/jira/browse/SPARK-27640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27640:
Assignee: (was: Apache Spark)
> Avoid duplicate lookups for datasource through
[
https://issues.apache.org/jira/browse/SPARK-27640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27640:
Assignee: Apache Spark
> Avoid duplicate lookups for datasource through provider
>
[
https://issues.apache.org/jira/browse/SPARK-27640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-27640:
---
Component/s: Structured Streaming
> Avoid duplicate lookups for datasource through provider
>
jiaan.geng created SPARK-27640:
--
Summary: Avoid duplicate lookups for datasource through provider
Key: SPARK-27640
URL: https://issues.apache.org/jira/browse/SPARK-27640
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros updated SPARK-27622:
---
Summary: Avoid network communication when block manger fetches from the
same host
[
https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros updated SPARK-27622:
---
Summary: Avoiding network communication when block manger fetching from the
same
[
https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros updated SPARK-27622:
---
Summary: Avoiding network communication when block mangers are running on
the same
[
https://issues.apache.org/jira/browse/SPARK-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833632#comment-16833632
]
Jeffrey(Xilang) Yan commented on SPARK-5594:
There is a bug before 2.2.3/2.3.0
If you met
[
https://issues.apache.org/jira/browse/SPARK-27639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27639:
Description:
It only shows InMemoryTableScan when scanning InMemoryTable.
When there are many
[
https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peng bo updated SPARK-27638:
Summary: date format -M-dd string comparison not handled properly
(was: date format -M-dd
[
https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peng bo updated SPARK-27638:
Summary: date format -M-dd comparison not handled properly (was: date
format -M-dd comparison
[
https://issues.apache.org/jira/browse/SPARK-27639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27639:
Assignee: (was: Apache Spark)
> InMemoryTableScan should show the table name on UI
>
[
https://issues.apache.org/jira/browse/SPARK-27639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27639:
Assignee: Apache Spark
> InMemoryTableScan should show the table name on UI
>
[
https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833584#comment-16833584
]
peng bo commented on SPARK-27638:
-
[~cloud_fan] [~srowen] Your opinion will be appreciated.
> date
Yuming Wang created SPARK-27639:
---
Summary: InMemoryTableScan should show the table name on UI
Key: SPARK-27639
URL: https://issues.apache.org/jira/browse/SPARK-27639
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peng bo updated SPARK-27638:
Description:
The below example works with both Mysql and Hive, however not with spark.
{code:java}
[
https://issues.apache.org/jira/browse/SPARK-27638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peng bo updated SPARK-27638:
Description:
The below example works with both Mysql and Hive, however not with spark.
{code:java}
peng bo created SPARK-27638:
---
Summary: date format -M-dd comparison isn't handled properly
Key: SPARK-27638
URL: https://issues.apache.org/jira/browse/SPARK-27638
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-27227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833558#comment-16833558
]
Song Jun edited comment on SPARK-27227 at 5/6/19 7:32 AM:
--
[~cloud_fan]
[
https://issues.apache.org/jira/browse/SPARK-27227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833558#comment-16833558
]
Song Jun commented on SPARK-27227:
--
[~cloud_fan] [~LI,Xiao] could you please help to review this SPIP?
[
https://issues.apache.org/jira/browse/SPARK-27227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Song Jun updated SPARK-27227:
-
Description:
When we equi-join one big table with a smaller table, we can collect some
statistics from
[
https://issues.apache.org/jira/browse/SPARK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833549#comment-16833549
]
Igor Berman commented on SPARK-24641:
-
I believe this issue is connected to
[
https://issues.apache.org/jira/browse/SPARK-27439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27439:
--
Summary: Explainging Dataset should show correct resolved plans (was: Use
analyzed plan when
[
https://issues.apache.org/jira/browse/SPARK-27439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27439.
---
Resolution: Fixed
Assignee: Liang-Chi Hsieh
This is resolved via
76 matches
Mail list logo
