[
https://issues.apache.org/jira/browse/SPARK-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2778.
Resolution: Fixed
Fix Version/s: 1.2.0
Fixed by:
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147465#comment-14147465
]
Patrick Wendell commented on SPARK-3687:
Can you perform a jstack on the executor
[
https://issues.apache.org/jira/browse/SPARK-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-3576.
Resolution: Fixed
This was fixed in spark-ec2 itself
Provide script for creating the
[
https://issues.apache.org/jira/browse/SPARK-3288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-3288:
---
Assignee: (was: Andrew Or)
All fields in TaskMetrics should be private and use
[
https://issues.apache.org/jira/browse/SPARK-3288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-3288:
---
Labels: starter (was: )
All fields in TaskMetrics should be private and use getters/setters
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147504#comment-14147504
]
Ziv Huang commented on SPARK-3687:
--
The following is the jstack dump of one executor when
Yi Tian created SPARK-3688:
--
Summary: LogicalPlan can't resolve column correctlly
Key: SPARK-3688
URL: https://issues.apache.org/jira/browse/SPARK-3688
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147513#comment-14147513
]
Ziv Huang commented on SPARK-3687:
--
Just a few mins ago I ran a job twice, processing 203
[
https://issues.apache.org/jira/browse/SPARK-3422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandy Ryza resolved SPARK-3422.
---
Resolution: Fixed
JavaAPISuite.getHadoopInputSplits isn't used anywhere
[
https://issues.apache.org/jira/browse/SPARK-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147520#comment-14147520
]
Yi Tian commented on SPARK-3688:
As we know, the hive support complex colunm datatype like
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147513#comment-14147513
]
Ziv Huang edited comment on SPARK-3687 at 9/25/14 8:36 AM:
---
Just
[
https://issues.apache.org/jira/browse/SPARK-3651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147619#comment-14147619
]
Apache Spark commented on SPARK-3651:
-
User 'tigerquoll' has created a pull request
Kousuke Saruta created SPARK-3689:
-
Summary: FileLogger should create new instance of FileSystem
regardless of it's scheme
Key: SPARK-3689
URL: https://issues.apache.org/jira/browse/SPARK-3689
[
https://issues.apache.org/jira/browse/SPARK-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147689#comment-14147689
]
Apache Spark commented on SPARK-3689:
-
User 'sarutak' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-3682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147730#comment-14147730
]
Arun Ahuja commented on SPARK-3682:
---
We've been running to a lot of these issues so this
[
https://issues.apache.org/jira/browse/SPARK-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147751#comment-14147751
]
Apache Spark commented on SPARK-3638:
-
User 'aniketbhatnagar' has created a pull
[
https://issues.apache.org/jira/browse/SPARK-3639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147758#comment-14147758
]
Apache Spark commented on SPARK-3639:
-
User 'aniketbhatnagar' has created a pull
Egor Pakhomov created SPARK-3690:
Summary: Closing shuffle writers we swallow more important
exception
Key: SPARK-3690
URL: https://issues.apache.org/jira/browse/SPARK-3690
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Egor Pakhomov updated SPARK-3690:
-
Description:
ShaffleMapTask: line 75
{code:title=Bar.java|borderStyle=solid}
case e: Exception
[
https://issues.apache.org/jira/browse/SPARK-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Egor Pakhomov updated SPARK-3690:
-
Description:
ShaffleMapTask: line 75
{code:title=ShaffleMapTask|borderStyle=solid}
case e:
[
https://issues.apache.org/jira/browse/SPARK-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147835#comment-14147835
]
Thomas Graves commented on SPARK-3678:
--
Also note that the spark-submit --name
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziv Huang updated SPARK-3687:
-
Comment: was deleted
(was: Just a few mins ago I ran a job twice, processing 203 sequence files.
Both
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziv Huang updated SPARK-3687:
-
Description:
In my application, I read more than 100 sequence files to a JavaPairRDD,
perform flatmap to
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147504#comment-14147504
]
Ziv Huang edited comment on SPARK-3687 at 9/25/14 3:09 PM:
---
The
[
https://issues.apache.org/jira/browse/SPARK-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147864#comment-14147864
]
Egor Pakhomov commented on SPARK-3690:
--
https://github.com/apache/spark/pull/2537
[
https://issues.apache.org/jira/browse/SPARK-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147867#comment-14147867
]
Apache Spark commented on SPARK-3690:
-
User 'epahomov' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147875#comment-14147875
]
Yu Ishikawa commented on SPARK-2516:
Hi [~mengxr],
I would like to work this issue, if
[
https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147918#comment-14147918
]
Arun Ahuja commented on SPARK-3633:
---
Which timeout values were increased to work around
[
https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147939#comment-14147939
]
Zhan Zhang commented on SPARK-3633:
---
Increasing timeout does not help my case either. I
[
https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148004#comment-14148004
]
Arun Ahuja commented on SPARK-3633:
---
Also, which timeout setting was useful:
[
https://issues.apache.org/jira/browse/SPARK-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148010#comment-14148010
]
Mayank Bansal commented on SPARK-3561:
--
HI Guys,
we at ebay are having some issues
[
https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148026#comment-14148026
]
Nishkam Ravi commented on SPARK-3633:
-
Increasing the value of
[
https://issues.apache.org/jira/browse/SPARK-546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148052#comment-14148052
]
Aaron Staple commented on SPARK-546:
Hi, I think there are two features requested in
Xuefu Zhang created SPARK-3691:
--
Summary: Provide a mini cluster for testing system built on Spark
Key: SPARK-3691
URL: https://issues.apache.org/jira/browse/SPARK-3691
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das updated SPARK-2932:
-
Fix Version/s: 1.2.0
Move MasterFailureTest out of main source directory
[
https://issues.apache.org/jira/browse/SPARK-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das resolved SPARK-2932.
--
Resolution: Fixed
Move MasterFailureTest out of main source directory
[
https://issues.apache.org/jira/browse/SPARK-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148071#comment-14148071
]
Xuefu Zhang commented on SPARK-3691:
cc [~sandyr]
Provide a mini cluster for testing
[
https://issues.apache.org/jira/browse/SPARK-3691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148071#comment-14148071
]
Xuefu Zhang edited comment on SPARK-3691 at 9/25/14 6:21 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148208#comment-14148208
]
Josh Rosen edited comment on SPARK-1823 at 9/25/14 7:42 PM:
[
https://issues.apache.org/jira/browse/SPARK-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148208#comment-14148208
]
Josh Rosen commented on SPARK-1823:
---
SPARK-3074 is a related issue for PySpark.
[
https://issues.apache.org/jira/browse/SPARK-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148244#comment-14148244
]
Andrew Ash commented on SPARK-2546:
---
Another proposed fix: extend JobConf as a shim and
[
https://issues.apache.org/jira/browse/SPARK-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148281#comment-14148281
]
Frens Jan Rumph commented on SPARK-1241:
Hi,
I'm investigating use of Spark for
Ekrem Aksoy created SPARK-3692:
--
Summary: RBF Kernel implementation to SVM
Key: SPARK-3692
URL: https://issues.apache.org/jira/browse/SPARK-3692
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-3692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ekrem Aksoy updated SPARK-3692:
---
Description: Radial Basis Function is another type of kernel that can be
used instead of linear
Xuefu Zhang created SPARK-3693:
--
Summary: Cached Hadoop RDD always return rows with the same value
Key: SPARK-3693
URL: https://issues.apache.org/jira/browse/SPARK-3693
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xuefu Zhang updated SPARK-3693:
---
Description:
While trying RDD caching, it's found that caching a Hadoop RDD causes data
correctness
[
https://issues.apache.org/jira/browse/SPARK-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148295#comment-14148295
]
Xuefu Zhang commented on SPARK-3693:
cc [~rxin], [~sandyr]
Cached Hadoop RDD always
[
https://issues.apache.org/jira/browse/SPARK-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148303#comment-14148303
]
Sandy Ryza commented on SPARK-3693:
---
Spark's documentation actually makes a note of
[
https://issues.apache.org/jira/browse/SPARK-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148306#comment-14148306
]
Reynold Xin commented on SPARK-3693:
Just responded to you offline as well. This is a
[
https://issues.apache.org/jira/browse/SPARK-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-3693.
Resolution: Duplicate
Cached Hadoop RDD always return rows with the same value
[
https://issues.apache.org/jira/browse/SPARK-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148318#comment-14148318
]
Xuefu Zhang commented on SPARK-3693:
Thanks, guys. We are fine with the workaround.
[
https://issues.apache.org/jira/browse/SPARK-3550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Staple resolved SPARK-3550.
-
Resolution: Fixed
Disable automatic rdd caching in python api for relevant learners
[
https://issues.apache.org/jira/browse/SPARK-3550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148347#comment-14148347
]
Aaron Staple commented on SPARK-3550:
-
This has been addressed in another commit:
[
https://issues.apache.org/jira/browse/SPARK-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Staple resolved SPARK-3488.
-
Resolution: Won't Fix
cache deserialized python RDDs before iterative learning
[
https://issues.apache.org/jira/browse/SPARK-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148365#comment-14148365
]
Josh Rosen commented on SPARK-3690:
---
For additional context, here's the mailing list
[
https://issues.apache.org/jira/browse/SPARK-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-3690.
---
Resolution: Fixed
Issue resolved by pull request 2537
[https://github.com/apache/spark/pull/2537]
[
https://issues.apache.org/jira/browse/SPARK-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-3661:
-
Priority: Critical (was: Major)
spark.driver.memory is ignored in cluster mode
[
https://issues.apache.org/jira/browse/SPARK-3682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandy Ryza updated SPARK-3682:
--
Description:
Spark has a zillion configuration options and a zillion different things that
can go
[
https://issues.apache.org/jira/browse/SPARK-3682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148379#comment-14148379
]
Sandy Ryza commented on SPARK-3682:
---
Oops, that should have read increased.
When a task
[
https://issues.apache.org/jira/browse/SPARK-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148385#comment-14148385
]
Davies Liu commented on SPARK-2377:
---
[~giwa] I also start to work on this (based on your
Patrick Wendell created SPARK-3694:
--
Summary: Allow printing object graph of tasks/RDD's with a debug
flag
Key: SPARK-3694
URL: https://issues.apache.org/jira/browse/SPARK-3694
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-3694:
---
Description:
This would be useful for debugging extra references inside of RDD's
Here is an
[
https://issues.apache.org/jira/browse/SPARK-3032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148411#comment-14148411
]
Andrew Ash edited comment on SPARK-3032 at 9/25/14 10:35 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-3032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148411#comment-14148411
]
Andrew Ash commented on SPARK-3032:
---
This bug prevents people from doing testing of
[
https://issues.apache.org/jira/browse/SPARK-1484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng resolved SPARK-1484.
--
Resolution: Fixed
Fix Version/s: 1.2.0
Issue resolved by pull request 2347
[
https://issues.apache.org/jira/browse/SPARK-1484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1484:
-
Assignee: Aaron Staple
MLlib should warn if you are using an iterative algorithm on non-cached
[
https://issues.apache.org/jira/browse/SPARK-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-3584.
Resolution: Fixed
Fix Version/s: 1.2.0
Assignee: Kousuke Saruta
[
https://issues.apache.org/jira/browse/SPARK-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148512#comment-14148512
]
Apache Spark commented on SPARK-2377:
-
User 'davies' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148529#comment-14148529
]
Xiangrui Meng commented on SPARK-1405:
--
[~Guoqiang Li] and [~pedrorodriguez], since
[
https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1405:
-
Assignee: Guoqiang Li (was: Xusen Yin)
parallel Latent Dirichlet Allocation (LDA) atop of spark
[
https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1405:
-
Shepherd: Xiangrui Meng
parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib
[
https://issues.apache.org/jira/browse/SPARK-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148549#comment-14148549
]
Xiangrui Meng commented on SPARK-1241:
--
This is implemented MLlib:
[
https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148555#comment-14148555
]
Pedro Rodriguez commented on SPARK-1405:
[~mengxr], definitely a good idea to be
[
https://issues.apache.org/jira/browse/SPARK-2634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-2634.
---
Resolution: Fixed
Fix Version/s: 1.2.0
Issue resolved by pull request 1541
[
https://issues.apache.org/jira/browse/SPARK-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148645#comment-14148645
]
Josh Rosen commented on SPARK-2546:
---
JobConf has a _ton_ of methods and it's not clear
Adrian Wang created SPARK-3695:
--
Summary: Enable to show host and port in block fetch failure
Key: SPARK-3695
URL: https://issues.apache.org/jira/browse/SPARK-3695
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-3695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148656#comment-14148656
]
Apache Spark commented on SPARK-3695:
-
User 'adrian-wang' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148657#comment-14148657
]
Josh Rosen commented on SPARK-2546:
---
A synchronization wrapper (whether written by hand
[
https://issues.apache.org/jira/browse/SPARK-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148666#comment-14148666
]
Andrew Ash commented on SPARK-2532:
---
[~pwendell] should we close this ticket and track
[
https://issues.apache.org/jira/browse/SPARK-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Tian updated SPARK-3688:
---
Description:
How to reproduce this problem:
create a table:
{code}
create table test (a string, b string);
[
https://issues.apache.org/jira/browse/SPARK-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-3686.
Resolution: Fixed
Resolved by:
https://github.com/apache/spark/pull/2531
81 matches
Mail list logo