[
https://issues.apache.org/jira/browse/SPARK-23627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Goun Na updated SPARK-23627:
Description:
Like rdd.isEmpty, adding isEmpty to DataSet would useful.
Some code without isEmpty:
{code:j
Goun Na created SPARK-23627:
---
Summary: Provide isEmpty() function in DataSet
Key: SPARK-23627
URL: https://issues.apache.org/jira/browse/SPARK-23627
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-23626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390832#comment-16390832
]
Ajith S commented on SPARK-23626:
-
Cc [~r...@databricks.com] , [~shivaram] [~blue_impala_
[
https://issues.apache.org/jira/browse/SPARK-23626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23626:
Assignee: (was: Apache Spark)
> Spark DAGScheduler scheduling performance hindered on
[
https://issues.apache.org/jira/browse/SPARK-23626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23626:
Assignee: Apache Spark
> Spark DAGScheduler scheduling performance hindered on JobSubmitte
[
https://issues.apache.org/jira/browse/SPARK-23626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390825#comment-16390825
]
Apache Spark commented on SPARK-23626:
--
User 'AjithShetty2489' has created a pull re
[
https://issues.apache.org/jira/browse/SPARK-23625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390817#comment-16390817
]
Yu Wang commented on SPARK-23625:
-
[~joshrosen] please have a look!!!
> spark sql long-r
Ajith S created SPARK-23626:
---
Summary: Spark DAGScheduler scheduling performance hindered on
JobSubmitted Event
Key: SPARK-23626
URL: https://issues.apache.org/jira/browse/SPARK-23626
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yu Wang updated SPARK-23625:
Attachment: 1520489867.png
1520489861.png
1520489854.png
152
Yu Wang created SPARK-23625:
---
Summary: spark sql long-running mission will be dead
Key: SPARK-23625
URL: https://issues.apache.org/jira/browse/SPARK-23625
Project: Spark
Issue Type: Bug
C
[
https://issues.apache.org/jira/browse/SPARK-23525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-23525:
Fix Version/s: 2.2.2
> ALTER TABLE CHANGE COLUMN doesn't work for external hive table
> ---
[
https://issues.apache.org/jira/browse/SPARK-23490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-23490:
Fix Version/s: 2.3.1
> Check storage.locationUri with existing table in CreateTable
>
[
https://issues.apache.org/jira/browse/SPARK-17498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390777#comment-16390777
]
Haopu Wang commented on SPARK-17498:
After this fix, the reverse transformation "Inde
[
https://issues.apache.org/jira/browse/SPARK-23624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23624:
Assignee: Apache Spark
> Revise doc of method pushFilters
> --
[
https://issues.apache.org/jira/browse/SPARK-23624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23624:
Assignee: (was: Apache Spark)
> Revise doc of method pushFilters
> ---
[
https://issues.apache.org/jira/browse/SPARK-23624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390761#comment-16390761
]
Apache Spark commented on SPARK-23624:
--
User 'gengliangwang' has created a pull requ
Gengliang Wang created SPARK-23624:
--
Summary: Revise doc of method pushFilters
Key: SPARK-23624
URL: https://issues.apache.org/jira/browse/SPARK-23624
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-23524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-23524:
---
Assignee: jin xing
> Big local shuffle blocks should not be checked for corruption.
> --
[
https://issues.apache.org/jira/browse/SPARK-23524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-23524.
-
Resolution: Fixed
Fix Version/s: 2.3.1
2.4.0
Issue resolved by pull req
[
https://issues.apache.org/jira/browse/SPARK-23525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390649#comment-16390649
]
Apache Spark commented on SPARK-23525:
--
User 'jiangxb1987' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-23623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23623:
Assignee: Tathagata Das (was: Apache Spark)
> Avoid concurrent use of cached KafkaConsume
[
https://issues.apache.org/jira/browse/SPARK-23623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390627#comment-16390627
]
Apache Spark commented on SPARK-23623:
--
User 'tdas' has created a pull request for t
[
https://issues.apache.org/jira/browse/SPARK-23623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23623:
Assignee: Apache Spark (was: Tathagata Das)
> Avoid concurrent use of cached KafkaConsume
[
https://issues.apache.org/jira/browse/SPARK-23623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das updated SPARK-23623:
--
Description:
CacheKafkaConsumer in the project `kafka-0-10-sql` is designed to maintain a
pool
[
https://issues.apache.org/jira/browse/SPARK-23623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das updated SPARK-23623:
--
Description:
CacheKafkaConsumer in the project `kafka-0-10-sql` is designed to maintain a
pool
Tathagata Das created SPARK-23623:
-
Summary: Avoid concurrent use of cached KafkaConsumer in
CachedKafkaConsumer (kafka-0-10-sql)
Key: SPARK-23623
URL: https://issues.apache.org/jira/browse/SPARK-23623
[
https://issues.apache.org/jira/browse/SPARK-23490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390601#comment-16390601
]
Apache Spark commented on SPARK-23490:
--
User 'gengliangwang' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-23406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390596#comment-16390596
]
Apache Spark commented on SPARK-23406:
--
User 'tdas' has created a pull request for t
[
https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-23020:
Fix Version/s: 2.3.1
> Re-enable Flaky Test:
> org.apache.spark.launcher.SparkLauncherSuite.testIn
[
https://issues.apache.org/jira/browse/SPARK-23436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390473#comment-16390473
]
Apache Spark commented on SPARK-23436:
--
User 'gatorsmile' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-23523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390461#comment-16390461
]
Apache Spark commented on SPARK-23523:
--
User 'gatorsmile' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-23562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390434#comment-16390434
]
yogesh garg edited comment on SPARK-23562 at 3/7/18 11:33 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-23562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390434#comment-16390434
]
yogesh garg commented on SPARK-23562:
-
Error in question can be reproduced with the f
[
https://issues.apache.org/jira/browse/SPARK-23562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390434#comment-16390434
]
yogesh garg edited comment on SPARK-23562 at 3/7/18 11:30 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-23560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-23560:
--
Description:
Depending on the size of the input, a joinWith followed by a groupBy requires
mor
Dongjoon Hyun created SPARK-23622:
-
Summary: HiveClientSuites fails with InvocationTargetException
Key: SPARK-23622
URL: https://issues.apache.org/jira/browse/SPARK-23622
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-21030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390321#comment-16390321
]
Dylan Guedes edited comment on SPARK-21030 at 3/7/18 10:11 PM:
[
https://issues.apache.org/jira/browse/SPARK-21030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390321#comment-16390321
]
Dylan Guedes edited comment on SPARK-21030 at 3/7/18 10:11 PM:
[
https://issues.apache.org/jira/browse/SPARK-21030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390321#comment-16390321
]
Dylan Guedes commented on SPARK-21030:
--
Hi,
I would like to try this one. Do you gu
[
https://issues.apache.org/jira/browse/SPARK-23525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-23525:
---
Assignee: Jiang Xingbo
> ALTER TABLE CHANGE COLUMN doesn't work for external hive table
> --
[
https://issues.apache.org/jira/browse/SPARK-23525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-23525.
-
Issue resolved by pull request 20696
[https://github.com/apache/spark/pull/20696]
> ALTER TABLE CHAN
[
https://issues.apache.org/jira/browse/SPARK-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390232#comment-16390232
]
Thomas Graves commented on SPARK-16630:
---
yes yarn tells you the # of nodemanagers.
[
https://issues.apache.org/jira/browse/SPARK-23620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23620:
Assignee: Apache Spark
> Split thread dump lines by using the br tag
> ---
[
https://issues.apache.org/jira/browse/SPARK-23620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390228#comment-16390228
]
Apache Spark commented on SPARK-23620:
--
User 'MaxGekk' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-23620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23620:
Assignee: (was: Apache Spark)
> Split thread dump lines by using the br tag
>
[
https://issues.apache.org/jira/browse/SPARK-23621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ravikumar Ramasamy updated SPARK-23621:
---
Description:
The configuration data is stored in Cassandra which is unstructured dat
[
https://issues.apache.org/jira/browse/SPARK-23621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ravikumar Ramasamy updated SPARK-23621:
---
Attachment: sample_data.csv
> DataFrame.insertInto() is persisting all columns for mi
Ravikumar Ramasamy created SPARK-23621:
--
Summary: DataFrame.insertInto() is persisting all columns for
mixed structured data-type
Key: SPARK-23621
URL: https://issues.apache.org/jira/browse/SPARK-23621
Maxim Gekk created SPARK-23620:
--
Summary: Split thread dump lines by using the br tag
Key: SPARK-23620
URL: https://issues.apache.org/jira/browse/SPARK-23620
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390159#comment-16390159
]
Imran Rashid commented on SPARK-16630:
--
I'd also take {{spark.yarn.max.executor.fail
[
https://issues.apache.org/jira/browse/SPARK-23560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390111#comment-16390111
]
Bruce Robbins commented on SPARK-23560:
---
The main issue is that an AttributeReferen
[
https://issues.apache.org/jira/browse/SPARK-23615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390055#comment-16390055
]
Huaxin Gao commented on SPARK-23615:
Hi Bryan, are you working on this youself? If no
Joe Pallas created SPARK-23619:
--
Summary: Document the column names created by explode and
posexplode functions
Key: SPARK-23619
URL: https://issues.apache.org/jira/browse/SPARK-23619
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-20922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389907#comment-16389907
]
Marcelo Vanzin commented on SPARK-20922:
You remediate it by upgrading to a versi
[
https://issues.apache.org/jira/browse/SPARK-20327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20327:
Assignee: Apache Spark
> Add CLI support for YARN custom resources, like GPUs
> --
[
https://issues.apache.org/jira/browse/SPARK-20327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389880#comment-16389880
]
Apache Spark commented on SPARK-20327:
--
User 'szyszy' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-20327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20327:
Assignee: (was: Apache Spark)
> Add CLI support for YARN custom resources, like GPUs
>
[
https://issues.apache.org/jira/browse/SPARK-23592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23592:
Assignee: Apache Spark (was: Marco Gaido)
> Add interpreted execution for DecodeUsingSeri
[
https://issues.apache.org/jira/browse/SPARK-23592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389871#comment-16389871
]
Apache Spark commented on SPARK-23592:
--
User 'mgaido91' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-23592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23592:
Assignee: Marco Gaido (was: Apache Spark)
> Add interpreted execution for DecodeUsingSeri
[
https://issues.apache.org/jira/browse/SPARK-23291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-23291:
-
Affects Version/s: 2.1.2
2.2.0
2.3.0
> SparkR : sub
[
https://issues.apache.org/jira/browse/SPARK-23291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung resolved SPARK-23291.
--
Resolution: Fixed
Assignee: Liang-Chi Hsieh
Fix Version/s: 2.4.0
Ta
[
https://issues.apache.org/jira/browse/SPARK-23591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hovell resolved SPARK-23591.
---
Resolution: Fixed
Fix Version/s: 2.4.0
> Add interpreted execution for EncodeU
[
https://issues.apache.org/jira/browse/SPARK-20922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389809#comment-16389809
]
Patrick John Esteban commented on SPARK-20922:
--
Hi Guys,
I'm new to this vu
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389766#comment-16389766
]
Kazuaki Ishizaki edited comment on SPARK-23598 at 3/7/18 4:39 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389766#comment-16389766
]
Kazuaki Ishizaki commented on SPARK-23598:
--
I also think that the easiest way is
[
https://issues.apache.org/jira/browse/SPARK-23535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-23535.
---
Resolution: Won't Fix
> MinMaxScaler return 0.5 for an all zero column
>
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389761#comment-16389761
]
Kazuaki Ishizaki commented on SPARK-18492:
--
[~imranshaik]
I ran the following pr
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389745#comment-16389745
]
David Vogelbacher commented on SPARK-23598:
---
[~hvanhovell] unfortunately, I can
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389723#comment-16389723
]
Nicholas Chammas commented on SPARK-18492:
--
[~imranshaik] - This is an open sour
[
https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaoju Wu updated SPARK-17495:
--
Comment: was deleted
(was: [~tejasp] I can see HiveHash merged but never used. Seems the using of
spar
[
https://issues.apache.org/jira/browse/SPARK-21157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389683#comment-16389683
]
assia ydroudj commented on SPARK-21157:
---
Is there a PR for this please?
> Report T
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389648#comment-16389648
]
imran shaik commented on SPARK-18492:
-
@Kazuaki Ishizaki any update on this?
> Gene
[
https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389644#comment-16389644
]
assia ydroudj commented on SPARK-23206:
---
[~elu] , thanks
I ll be for wait!
I hav
[
https://issues.apache.org/jira/browse/SPARK-23534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389629#comment-16389629
]
Darek commented on SPARK-23534:
---
We need a resolution sooner than later. Most vendors have
[
https://issues.apache.org/jira/browse/SPARK-23611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hovell resolved SPARK-23611.
---
Resolution: Fixed
Fix Version/s: 2.4.0
> Extend ExpressionEvalHelper harness t
[
https://issues.apache.org/jira/browse/SPARK-14681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389382#comment-16389382
]
Apache Spark commented on SPARK-14681:
--
User 'WeichenXu123' has created a pull reque
77 matches
Mail list logo