[
https://issues.apache.org/jira/browse/SPARK-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14018512#comment-14018512
]
Sean Owen commented on SPARK-2026:
--
A few people have mentioned and asked for this,
Chen Chao created SPARK-2031:
Summary: DAGScheduler supports pluggable clock
Key: SPARK-2031
URL: https://issues.apache.org/jira/browse/SPARK-2031
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-2031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14018533#comment-14018533
]
Chen Chao commented on SPARK-2031:
--
PR https://github.com/apache/spark/pull/976
Matei Zaharia created SPARK-2032:
Summary: Add an RDD.samplePartitions method for partition-level
sampling
Key: SPARK-2032
URL: https://issues.apache.org/jira/browse/SPARK-2032
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matei Zaharia updated SPARK-2032:
-
Priority: Minor (was: Major)
Add an RDD.samplePartitions method for partition-level sampling
[
https://issues.apache.org/jira/browse/SPARK-1228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng closed SPARK-1228.
Resolution: Implemented
Fix Version/s: 1.0.0
Assignee: Xiangrui Meng
Confusion
Guoqiang Li created SPARK-2033:
--
Summary: Automatically cleanup checkpoint
Key: SPARK-2033
URL: https://issues.apache.org/jira/browse/SPARK-2033
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sam updated SPARK-2019:
---
Affects Version/s: (was: 0.9.1)
0.9.0
Spark workers die/disappear when job fails for
[
https://issues.apache.org/jira/browse/SPARK-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sam updated SPARK-2019:
---
Fix Version/s: (was: 0.9.2)
Spark workers die/disappear when job fails for nearly any reason
[
https://issues.apache.org/jira/browse/SPARK-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14018621#comment-14018621
]
Guoqiang Li commented on SPARK-2033:
The PR: https://github.com/apache/spark/pull/855
[
https://issues.apache.org/jira/browse/SPARK-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14018048#comment-14018048
]
sam edited comment on SPARK-2019 at 6/5/14 9:47 AM:
Sorry. Its -0.9.1-
[
https://issues.apache.org/jira/browse/SPARK-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sam updated SPARK-2019:
---
Priority: Major (was: Critical)
Spark workers die/disappear when job fails for nearly any reason
[
https://issues.apache.org/jira/browse/SPARK-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14018756#comment-14018756
]
sam commented on SPARK-2019:
[~srowen] so when will CDH package up and distribute spark
[
https://issues.apache.org/jira/browse/SPARK-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14018760#comment-14018760
]
Sean Owen commented on SPARK-2019:
--
I believe that's coming with 5.1 but I don't know
[
https://issues.apache.org/jira/browse/SPARK-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel Darabos updated SPARK-2035:
--
Attachment: example-html.tgz
I've sent a pull request
[
https://issues.apache.org/jira/browse/SPARK-2024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kan Zhang updated SPARK-2024:
-
Comment: was deleted
(was: You meant SPARK-1416?)
Add saveAsSequenceFile to PySpark
Takuya Ueshin created SPARK-2036:
Summary: CaseConversionExpression should check if the evaluated
value is null.
Key: SPARK-2036
URL: https://issues.apache.org/jira/browse/SPARK-2036
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14018928#comment-14018928
]
Takuya Ueshin commented on SPARK-2036:
--
PRed:
Thomas Graves created SPARK-2037:
Summary: yarn client mode doesn't support
spark.yarn.max.executor.failures
Key: SPARK-2037
URL: https://issues.apache.org/jira/browse/SPARK-2037
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2019:
---
Description:
We either have to reboot all the nodes, or run 'sudo service spark-worker
[
https://issues.apache.org/jira/browse/SPARK-2029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2029.
Resolution: Fixed
Fix Version/s: 1.1.0
Issue resolved by pull request 974
[
https://issues.apache.org/jira/browse/SPARK-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2030.
Resolution: Fixed
Fix Version/s: 1.0.1
Issue resolved by pull request 975
[
https://issues.apache.org/jira/browse/SPARK-1677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-1677.
Resolution: Fixed
Fix Version/s: 1.1.0
1.0.1
Issue resolved by
Patrick Wendell created SPARK-2039:
--
Summary: Run hadoop output checks for all formats
Key: SPARK-2039
URL: https://issues.apache.org/jira/browse/SPARK-2039
Project: Spark
Issue Type:
Patrick Wendell created SPARK-2040:
--
Summary: Support cross-building with Scala 2.11
Key: SPARK-2040
URL: https://issues.apache.org/jira/browse/SPARK-2040
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-1812:
---
Description:
Since Scala 2.10/2.11 are source compatible, we should be able to cross build
[
https://issues.apache.org/jira/browse/SPARK-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-1812:
---
Assignee: Prashant Sharma
Support Scala 2.11
--
Key:
[
https://issues.apache.org/jira/browse/SPARK-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-1812:
---
Summary: Support cross-building with Scala 2.11 (was: Support Scala 2.11)
Support
[
https://issues.apache.org/jira/browse/SPARK-1749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-1749:
---
Target Version/s: 1.0.1, 1.1.0 (was: 1.0.1)
DAGScheduler supervisor strategy broken with
Michael Armbrust created SPARK-2041:
---
Summary: Exception when querying when tableName == columnName
Key: SPARK-2041
URL: https://issues.apache.org/jira/browse/SPARK-2041
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-2010:
Assignee: Kan Zhang (was: Michael Armbrust)
Support for nested data in PySpark SQL
[
https://issues.apache.org/jira/browse/SPARK-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust reassigned SPARK-2010:
---
Assignee: Michael Armbrust
Support for nested data in PySpark SQL
[
https://issues.apache.org/jira/browse/SPARK-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019279#comment-14019279
]
Bernardo Gomez Palacio commented on SPARK-2026:
---
I'll submit a PR [~srowen].
Michael Armbrust created SPARK-2042:
---
Summary: Take triggers unneeded shuffle.
Key: SPARK-2042
URL: https://issues.apache.org/jira/browse/SPARK-2042
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kan Zhang updated SPARK-937:
Comment: was deleted
(was: Hi Aaron, are you still working on this one? If not, could you assign it
to me?
[
https://issues.apache.org/jira/browse/SPARK-937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019309#comment-14019309
]
Kan Zhang commented on SPARK-937:
-
PR: https://github.com/apache/spark/pull/306
Executors
Matei Zaharia created SPARK-2043:
Summary: ExternalAppendOnlyMap doesn't always find matching keys
Key: SPARK-2043
URL: https://issues.apache.org/jira/browse/SPARK-2043
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019394#comment-14019394
]
Mridul Muralidharan commented on SPARK-2017:
Currently, for our jobs, I run
Matei Zaharia created SPARK-2045:
Summary: Sort-based shuffle implementation
Key: SPARK-2045
URL: https://issues.apache.org/jira/browse/SPARK-2045
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-2011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankur Dave updated SPARK-2011:
--
Priority: Minor (was: Major)
Eliminate duplicate join in Pregel
--
[
https://issues.apache.org/jira/browse/SPARK-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019449#comment-14019449
]
Patrick Wendell commented on SPARK-2019:
Hey @sams - I'm going to temporarily
[
https://issues.apache.org/jira/browse/SPARK-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2019.
Resolution: Incomplete
Spark workers die/disappear when job fails for nearly any reason
Zongheng Yang created SPARK-2046:
Summary: Support config properties that are changeable across
tasks/stages within a job
Key: SPARK-2046
URL: https://issues.apache.org/jira/browse/SPARK-2046
[
https://issues.apache.org/jira/browse/SPARK-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019457#comment-14019457
]
Zongheng Yang commented on SPARK-2046:
--
[~shivaram]
Support config properties that
[
https://issues.apache.org/jira/browse/SPARK-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019458#comment-14019458
]
Shivaram Venkataraman commented on SPARK-2046:
--
FWIW I have an older
Matei Zaharia created SPARK-2047:
Summary: Use less memory in AppendOnlyMap.destructiveSortedIterator
Key: SPARK-2047
URL: https://issues.apache.org/jira/browse/SPARK-2047
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-2047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matei Zaharia updated SPARK-2047:
-
Priority: Minor (was: Major)
Use less memory in AppendOnlyMap.destructiveSortedIterator
[
https://issues.apache.org/jira/browse/SPARK-2047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matei Zaharia updated SPARK-2047:
-
Priority: Major (was: Minor)
Use less memory in AppendOnlyMap.destructiveSortedIterator
[
https://issues.apache.org/jira/browse/SPARK-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019482#comment-14019482
]
Matei Zaharia commented on SPARK-2043:
--
https://github.com/apache/spark/pull/986
egraldlo created SPARK-2049:
---
Summary: avg function in aggregation may cause overflow
Key: SPARK-2049
URL: https://issues.apache.org/jira/browse/SPARK-2049
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-1988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankur Dave resolved SPARK-1988.
---
Resolution: Fixed
This is mitigated by SPARK-1991, because the user can increase the number of
edge
[
https://issues.apache.org/jira/browse/SPARK-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-2042:
Assignee: Sameer Agarwal
Take triggers unneeded shuffle.
---
[
https://issues.apache.org/jira/browse/SPARK-2044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019511#comment-14019511
]
Saisai Shao commented on SPARK-2044:
Hi Matei, it's great to see you guys have plan on
[
https://issues.apache.org/jira/browse/SPARK-2044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019531#comment-14019531
]
Raymond Liu edited comment on SPARK-2044 at 6/6/14 3:11 AM:
Hi
Guoqiang Li created SPARK-2051:
--
Summary: In yarn.ClientBase spark.yarn.dist.* do not work
Key: SPARK-2051
URL: https://issues.apache.org/jira/browse/SPARK-2051
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-2051:
---
Description:
Spark configuration
{{conf/spark-defaults.conf}}:
{quote}
spark.yarn.dist.archives
[
https://issues.apache.org/jira/browse/SPARK-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019560#comment-14019560
]
Guoqiang Li commented on SPARK-2051:
The PR: https://github.com/apache/spark/pull/969
Takuya Ueshin created SPARK-2052:
Summary: Add optimization for CaseConversionExpression's.
Key: SPARK-2052
URL: https://issues.apache.org/jira/browse/SPARK-2052
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019578#comment-14019578
]
Takuya Ueshin commented on SPARK-2052:
--
PRed:
[
https://issues.apache.org/jira/browse/SPARK-1704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019599#comment-14019599
]
Reynold Xin commented on SPARK-1704:
Explain should probably just print out the sql
60 matches
Mail list logo