[
https://issues.apache.org/jira/browse/SPARK-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144411#comment-14144411
]
Apache Spark commented on SPARK-3172:
-
User 'sryza' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144412#comment-14144412
]
Apache Spark commented on SPARK-3577:
-
User 'sryza' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144421#comment-14144421
]
Apache Spark commented on SPARK-3481:
-
User 'scwf' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng reassigned SPARK-3541:
Assignee: Xiangrui Meng
Improve ALS internal storage
[
https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144490#comment-14144490
]
Patrick Wendell commented on SPARK-3633:
[~nravi] if you are trying to debug this,
[
https://issues.apache.org/jira/browse/SPARK-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144493#comment-14144493
]
Chris Gore commented on SPARK-3368:
---
Thanks for filing this; I'm glad I'm not the only
[
https://issues.apache.org/jira/browse/SPARK-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144510#comment-14144510
]
Apache Spark commented on SPARK-3582:
-
User 'adrian-wang' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144508#comment-14144508
]
Adrian Wang commented on SPARK-3582:
Hi Saurabh, I have created a PR(
[
https://issues.apache.org/jira/browse/SPARK-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144514#comment-14144514
]
Ravindra Pesala commented on SPARK-3371:
It seems like an issue, By default SQl
yangping wu created SPARK-3656:
--
Summary: IllegalArgumentException when I using sort-based shuffle
Key: SPARK-3656
URL: https://issues.apache.org/jira/browse/SPARK-3656
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-3656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yangping wu updated SPARK-3656:
---
Description:
The code work fine in hash-based shuffle.
[
https://issues.apache.org/jira/browse/SPARK-3656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yangping wu updated SPARK-3656:
---
Description:
The code work fine in hash-based shuffle.
{code}
[
https://issues.apache.org/jira/browse/SPARK-3656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144588#comment-14144588
]
Sean Owen commented on SPARK-3656:
--
Duplicate of
[
https://issues.apache.org/jira/browse/SPARK-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144755#comment-14144755
]
Apache Spark commented on SPARK-3356:
-
User 'srowen' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-2668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-2668.
--
Resolution: Fixed
Fix Version/s: 1.2.0
Add variable of yarn log directory for reference
[
https://issues.apache.org/jira/browse/SPARK-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144943#comment-14144943
]
Trevor McKay commented on SPARK-3644:
-
Anecdotal notes from a consumer :) I recently
[
https://issues.apache.org/jira/browse/SPARK-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144946#comment-14144946
]
Thomas Graves commented on SPARK-3445:
--
Any other comments or objections to this?
Thomas Graves created SPARK-3657:
Summary: yarn alpha YarnRMClientImpl throws NPE
appMasterRequest.setTrackingUrl starting spark-shell
Key: SPARK-3657
URL: https://issues.apache.org/jira/browse/SPARK-3657
[
https://issues.apache.org/jira/browse/SPARK-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3477.
--
Resolution: Fixed
Fix Version/s: 1.2.0
Clean up code in Yarn Client / ClientBase
[
https://issues.apache.org/jira/browse/SPARK-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-3304.
--
Resolution: Fixed
Fix Version/s: 1.2.0
Assignee: Kousuke Saruta
WangTaoTheTonic created SPARK-3658:
--
Summary: Take thrift server as a daemon
Key: SPARK-3658
URL: https://issues.apache.org/jira/browse/SPARK-3658
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145017#comment-14145017
]
Apache Spark commented on SPARK-3658:
-
User 'WangTaoTheTonic' has created a pull
[
https://issues.apache.org/jira/browse/SPARK-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145192#comment-14145192
]
Michael Armbrust commented on SPARK-2870:
-
Yeah, though we might want to benchmark
[
https://issues.apache.org/jira/browse/SPARK-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-3598.
-
Resolution: Fixed
Fix Version/s: 1.2.0
Issue resolved by pull request 2458
[
https://issues.apache.org/jira/browse/SPARK-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-3582:
Assignee: Adrian Wang
Spark SQL having issue with existing Hive UDFs which take Map as a
[
https://issues.apache.org/jira/browse/SPARK-3536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-3536.
-
Resolution: Fixed
Fix Version/s: 1.2.0
Issue resolved by pull request 2456
Shivaram Venkataraman created SPARK-3659:
Summary: Set EC2 version to 1.1.0 in master branch
Key: SPARK-3659
URL: https://issues.apache.org/jira/browse/SPARK-3659
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-3659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145239#comment-14145239
]
Apache Spark commented on SPARK-3659:
-
User 'shivaram' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matei Zaharia updated SPARK-2745:
-
Assignee: Sean Owen (was: Sean Owen)
Add Java friendly methods to Duration class
[
https://issues.apache.org/jira/browse/SPARK-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matei Zaharia updated SPARK-2745:
-
Assignee: Sean Owen (was: Tathagata Das)
Add Java friendly methods to Duration class
[
https://issues.apache.org/jira/browse/SPARK-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matei Zaharia resolved SPARK-2745.
--
Resolution: Fixed
Fix Version/s: 1.2.0
Add Java friendly methods to Duration class
[
https://issues.apache.org/jira/browse/SPARK-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145258#comment-14145258
]
Ravindra Pesala commented on SPARK-3371:
https://github.com/apache/spark/pull/2511
[
https://issues.apache.org/jira/browse/SPARK-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145262#comment-14145262
]
Apache Spark commented on SPARK-3371:
-
User 'ravipesala' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matei Zaharia updated SPARK-3389:
-
Target Version/s: 1.2.0
Add converter class to make reading Parquet files easy with PySpark
[
https://issues.apache.org/jira/browse/SPARK-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matei Zaharia updated SPARK-3389:
-
Assignee: Uri Laserson
Add converter class to make reading Parquet files easy with PySpark
[
https://issues.apache.org/jira/browse/SPARK-3268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-3268.
-
Resolution: Fixed
Fix Version/s: 1.2.0
DoubleType should support modulus
[
https://issues.apache.org/jira/browse/SPARK-3268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-3268:
Assignee: Venkata Ramana G
DoubleType should support modulus
[
https://issues.apache.org/jira/browse/SPARK-3646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-3646.
-
Resolution: Fixed
Fix Version/s: 1.2.0
Copy SQL options from the spark context
[
https://issues.apache.org/jira/browse/SPARK-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145324#comment-14145324
]
Matei Zaharia edited comment on SPARK-3129 at 9/23/14 7:53 PM:
[
https://issues.apache.org/jira/browse/SPARK-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145324#comment-14145324
]
Matei Zaharia commented on SPARK-3129:
--
Is that 100 MB/s per node or in total? That
Soumitra Kumar created SPARK-3660:
-
Summary: Initial RDD for updateStateByKey transformation
Key: SPARK-3660
URL: https://issues.apache.org/jira/browse/SPARK-3660
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-3647.
Resolution: Fixed
Fixed by Marcelo in this patch:
[
https://issues.apache.org/jira/browse/SPARK-3612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-3612.
Resolution: Fixed
Fix Version/s: 1.2.0
1.1.1
Assignee:
[
https://issues.apache.org/jira/browse/SPARK-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145411#comment-14145411
]
Hari Shreedharan commented on SPARK-3129:
-
It is per node, single threaded.
[
https://issues.apache.org/jira/browse/SPARK-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or closed SPARK-3653.
Resolution: Fixed
Fix Version/s: 1.2.0
1.1.1
SPARK_{DRIVER|EXECUTOR}_MEMORY is
Andrew Or created SPARK-3661:
Summary: spark.driver.memory is ignored in cluster mode
Key: SPARK-3661
URL: https://issues.apache.org/jira/browse/SPARK-3661
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or closed SPARK-1853.
Resolution: Fixed
Fix Version/s: 1.1.1
Target Version/s: 1.1.1, 1.2.0 (was: 1.2.0)
Show
[
https://issues.apache.org/jira/browse/SPARK-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145537#comment-14145537
]
Matei Zaharia commented on SPARK-3129:
--
Alright, in that case, this sounds pretty
[
https://issues.apache.org/jira/browse/SPARK-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145541#comment-14145541
]
Hari Shreedharan commented on SPARK-3129:
-
Sure. Thanks Matei!
Prevent data loss
[
https://issues.apache.org/jira/browse/SPARK-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joseph K. Bradley updated SPARK-3573:
-
Description:
This JIRA is for discussion of ML dataset, essentially a SchemaRDD with
[
https://issues.apache.org/jira/browse/SPARK-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joseph K. Bradley updated SPARK-3573:
-
Description:
This JIRA is for discussion of ML dataset, essentially a SchemaRDD with
Evan Samanas created SPARK-3662:
---
Summary: Importing pandas breaks included pi.py example
Key: SPARK-3662
URL: https://issues.apache.org/jira/browse/SPARK-3662
Project: Spark
Issue Type: Bug
Andrew Ash created SPARK-3663:
-
Summary: Document SPARK_LOG_DIR and SPARK_PID_DIR
Key: SPARK-3663
URL: https://issues.apache.org/jira/browse/SPARK-3663
Project: Spark
Issue Type: Documentation
Ankur Dave created SPARK-3664:
-
Summary: Graduate GraphX from alpha to stable
Key: SPARK-3664
URL: https://issues.apache.org/jira/browse/SPARK-3664
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankur Dave updated SPARK-3665:
--
Component/s: GraphX
Java API for GraphX
---
Key: SPARK-3665
Ankur Dave created SPARK-3665:
-
Summary: Java API for GraphX
Key: SPARK-3665
URL: https://issues.apache.org/jira/browse/SPARK-3665
Project: Spark
Issue Type: Improvement
Reporter:
Ankur Dave created SPARK-3666:
-
Summary: Extract interfaces for EdgeRDD and VertexRDD
Key: SPARK-3666
URL: https://issues.apache.org/jira/browse/SPARK-3666
Project: Spark
Issue Type: Improvement
Ankur Dave created SPARK-3667:
-
Summary: Deprecate Graph#unpersistVertices and document how to
correctly unpersist graphs
Key: SPARK-3667
URL: https://issues.apache.org/jira/browse/SPARK-3667
Project:
[
https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankur Dave updated SPARK-3665:
--
Description:
The Java API will wrap the Scala API in a similar manner as JavaRDD. Components
will
[
https://issues.apache.org/jira/browse/SPARK-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankur Dave updated SPARK-3664:
--
Description: The GraphX API is officially marked as alpha but has been
moving toward stability. This
[
https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankur Dave updated SPARK-3665:
--
Description:
The Java API will wrap the Scala API in a similar manner as JavaRDD. Components
will
[
https://issues.apache.org/jira/browse/SPARK-2142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandy Ryza resolved SPARK-2142.
---
Resolution: Not a Problem
I ran some tests that indicated that only stop-the-world GC time gets
[
https://issues.apache.org/jira/browse/SPARK-3610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145663#comment-14145663
]
SK commented on SPARK-3610:
---
I made the following change to EventLoggingListener.scala, L57 and
Ankur Dave created SPARK-3668:
-
Summary: Support for arbitrary key types in IndexedRDD
Key: SPARK-3668
URL: https://issues.apache.org/jira/browse/SPARK-3668
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankur Dave updated SPARK-3668:
--
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-2365
Support for arbitrary key types in
Ankur Dave created SPARK-3669:
-
Summary: Extract IndexedRDD interface
Key: SPARK-3669
URL: https://issues.apache.org/jira/browse/SPARK-3669
Project: Spark
Issue Type: Sub-task
Ankur Dave created SPARK-3670:
-
Summary: Add log-structured updates with merge
Key: SPARK-3670
URL: https://issues.apache.org/jira/browse/SPARK-3670
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145676#comment-14145676
]
Nishkam Ravi commented on SPARK-3633:
-
[~pwendell] I see a large number of open files
Ankur Dave created SPARK-3671:
-
Summary: Batch multiput updates within partitions
Key: SPARK-3671
URL: https://issues.apache.org/jira/browse/SPARK-3671
Project: Spark
Issue Type: Sub-task
Ankur Dave created SPARK-3672:
-
Summary: Add a non-updatable implementation for read performance
Key: SPARK-3672
URL: https://issues.apache.org/jira/browse/SPARK-3672
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145686#comment-14145686
]
Andrew Ash commented on SPARK-3633:
---
Hi [~nravi] you can also check the limits on an
Ankur Dave created SPARK-3673:
-
Summary: Move IndexedRDD from a pull request into a separate
repository
Key: SPARK-3673
URL: https://issues.apache.org/jira/browse/SPARK-3673
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145698#comment-14145698
]
Ankur Dave commented on SPARK-2365:
---
[~imranr] Thanks for the comments and
[
https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankur Dave updated SPARK-3665:
--
Component/s: Java API
Java API for GraphX
---
Key: SPARK-3665
[
https://issues.apache.org/jira/browse/SPARK-3645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145709#comment-14145709
]
Apache Spark commented on SPARK-3645:
-
User 'liancheng' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145713#comment-14145713
]
Nishkam Ravi commented on SPARK-3633:
-
Looks ok (still waiting on the run to
[
https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145749#comment-14145749
]
Nishkam Ravi commented on SPARK-3633:
-
Unsurprisingly, the run goes through. It would
[
https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145754#comment-14145754
]
Andrew Ash commented on SPARK-3633:
---
You're getting exceptions but they're not fatal to
[
https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145763#comment-14145763
]
Nishkam Ravi commented on SPARK-3633:
-
With higher values of ulimit and timeout
[
https://issues.apache.org/jira/browse/SPARK-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145829#comment-14145829
]
Sandy Ryza commented on SPARK-3468:
---
This looks like a really cool addition.
WebUI
Shivaram Venkataraman created SPARK-3674:
Summary: Add support for launching YARN clusters in spark-ec2
Key: SPARK-3674
URL: https://issues.apache.org/jira/browse/SPARK-3674
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-3032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145887#comment-14145887
]
Apache Spark commented on SPARK-3032:
-
User 'jerryshao' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-3032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-3032:
---
Priority: Blocker (was: Critical)
Potential bug when running sort-based shuffle with
[
https://issues.apache.org/jira/browse/SPARK-3642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145918#comment-14145918
]
Josh Rosen commented on SPARK-3642:
---
I've linked this JIRA to a couple of related
84 matches
Mail list logo
