[jira] [Commented] (SPARK-1902) Spark shell prints error when :4040 port already in use

2014-05-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14007684#comment-14007684 ] Patrick Wendell commented on SPARK-1902: Yeah, this would be a good one to fix.

[jira] [Resolved] (SPARK-1923) ClassNotFoundException when running with sbt and Scala 2.10.3

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1923. Resolution: Fixed ClassNotFoundException when running with sbt and Scala 2.10.3

[jira] [Resolved] (SPARK-1410) Class not found exception with application launched from sbt 0.13.x

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1410. Resolution: Fixed Assignee: Xiangrui Meng Solution is to upgrade to Scala 2.10.4.

[jira] [Updated] (SPARK-1923) ClassNotFoundException when running with sbt and Scala 2.10.3

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1923: --- Description: I just wanted to document this for posterity. I had an issue when running a

[jira] [Updated] (SPARK-1887) Update Contributors Guide with useful data from past threads

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1887: --- Assignee: (was: Patrick Wendell) Update Contributors Guide with useful data from past

[jira] [Assigned] (SPARK-1887) Update Contributors Guide with useful data from past threads

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-1887: -- Assignee: Patrick Wendell Update Contributors Guide with useful data from past

[jira] [Updated] (SPARK-1887) Update Contributors Guide with useful data from past threads

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1887: --- Assignee: Sujeet Varakhedi Update Contributors Guide with useful data from past threads

[jira] [Updated] (SPARK-1894) The default ec2 set-up ignores --driver-class-path

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1894: --- Issue Type: Task (was: Bug) The default ec2 set-up ignores --driver-class-path

[jira] [Updated] (SPARK-1894) The default ec2 set-up ignores --driver-class-path

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1894: --- Component/s: EC2 The default ec2 set-up ignores --driver-class-path

[jira] [Resolved] (SPARK-1894) The default ec2 set-up ignores --driver-class-path

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1894. Resolution: Fixed Fix Version/s: (was: 1.0.1) 1.0.0

[jira] [Assigned] (SPARK-1843) Provide a simpler alternative to assemble-deps

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-1843: -- Assignee: Patrick Wendell (was: Prashant Sharma) Provide a simpler alternative to

[jira] [Updated] (SPARK-1518) Spark master doesn't compile against hadoop-common trunk

2014-05-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1518: --- Assignee: Colin Patrick McCabe Spark master doesn't compile against hadoop-common trunk

[jira] [Commented] (SPARK-983) Support external sorting for RDD#sortByKey()

2014-05-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14009145#comment-14009145 ] Patrick Wendell commented on SPARK-983: --- We are actually looking at this problem in a

[jira] [Commented] (SPARK-1784) Add a partitioner which partitions an RDD with each partition having specified # of keys

2014-05-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14009184#comment-14009184 ] Patrick Wendell commented on SPARK-1784: I think this might be subsumed by the fix

[jira] [Comment Edited] (SPARK-1935) Explicitly add commons-codec 1.4 as a dependency

2014-05-26 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14009283#comment-14009283 ] Patrick Wendell edited comment on SPARK-1935 at 5/27/14 5:11 AM:

[jira] [Commented] (SPARK-1518) Spark master doesn't compile against hadoop-common trunk

2014-05-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14010117#comment-14010117 ] Patrick Wendell commented on SPARK-1518: Ah okay. I'm not sure what the oldest

[jira] [Commented] (SPARK-1930) The Container is running beyond physical memory limits, so as to be killed.

2014-05-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14010258#comment-14010258 ] Patrick Wendell commented on SPARK-1930: PySpark might also be an issue with this,

[jira] [Updated] (SPARK-1518) Spark master doesn't compile against hadoop-common trunk

2014-05-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1518: --- Priority: Critical (was: Major) Spark master doesn't compile against hadoop-common trunk

[jira] [Updated] (SPARK-1931) Graph.partitionBy does not reconstruct routing tables

2014-05-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1931: --- Fix Version/s: (was: 1.0.0) 1.0.1 Graph.partitionBy does not

[jira] [Commented] (SPARK-1518) Spark master doesn't compile against hadoop-common trunk

2014-05-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14010339#comment-14010339 ] Patrick Wendell commented on SPARK-1518: Re: versioning - I was just asking

[jira] [Created] (SPARK-1943) Testing use of target version field

2014-05-27 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1943: -- Summary: Testing use of target version field Key: SPARK-1943 URL: https://issues.apache.org/jira/browse/SPARK-1943 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-1943) Testing use of target version field

2014-05-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1943: --- Target Version/s: (was: 0.9.2, 1.0.1) Testing use of target version field

[jira] [Updated] (SPARK-1916) SparkFlumeEvent with body bigger than 1020 bytes are not read properly

2014-05-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1916: --- Assignee: David Lemieux SparkFlumeEvent with body bigger than 1020 bytes are not read

[jira] [Updated] (SPARK-1952) slf4j version conflicts with pig

2014-05-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1952: --- Target Version/s: 1.0.1 (was: 1.0.0) slf4j version conflicts with pig

[jira] [Updated] (SPARK-1952) slf4j version conflicts with pig

2014-05-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1952: --- Fix Version/s: (was: 1.0.0) slf4j version conflicts with pig

[jira] [Resolved] (SPARK-1916) SparkFlumeEvent with body bigger than 1020 bytes are not read properly

2014-05-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1916. Resolution: Fixed Fix Version/s: 0.9.2 1.0.1 Issue resolved by

[jira] [Updated] (SPARK-1576) Passing of JAVA_OPTS to YARN on command line

2014-05-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1576: --- Fix Version/s: (was: 0.9.1) 0.9.2 Passing of JAVA_OPTS to YARN on

[jira] [Updated] (SPARK-1849) Broken UTF-8 encoded data gets character replacements and thus can't be fixed

2014-05-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1849: --- Fix Version/s: (was: 0.9.1) 0.9.2 Broken UTF-8 encoded data gets

[jira] [Updated] (SPARK-1759) sbt/sbt package fail cause by directory

2014-05-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1759: --- Fix Version/s: (was: 0.9.1) 0.9.2 sbt/sbt package fail cause by

[jira] [Commented] (SPARK-1952) slf4j version conflicts with pig

2014-05-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14011806#comment-14011806 ] Patrick Wendell commented on SPARK-1952: Hm, unfortunately I dont' see any obvious

[jira] [Commented] (SPARK-1952) slf4j version conflicts with pig

2014-05-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14011808#comment-14011808 ] Patrick Wendell commented on SPARK-1952: [~rcompton] - what if you modify the

[jira] [Commented] (SPARK-1954) Make it easier to get Spark on YARN code to compile in IntelliJ

2014-05-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14011810#comment-14011810 ] Patrick Wendell commented on SPARK-1954: Have you tried running sbt/sbt gen-idea

[jira] [Resolved] (SPARK-1950) spark on yarn can't start

2014-05-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1950. Resolution: Duplicate spark on yarn can't start --

[jira] [Updated] (SPARK-1901) Standalone worker update exector's state ahead of executor process exit

2014-05-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1901: --- Fix Version/s: (was: 1.0.0) 1.0.1 Standalone worker update exector's

[jira] [Commented] (SPARK-1952) slf4j version conflicts with pig

2014-05-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14012040#comment-14012040 ] Patrick Wendell commented on SPARK-1952: So I think the issue here is simply that

[jira] [Updated] (SPARK-1954) Make it easier to get Spark on YARN code to compile in IntelliJ

2014-05-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1954: --- Component/s: Build Make it easier to get Spark on YARN code to compile in IntelliJ

[jira] [Updated] (SPARK-1518) Spark master doesn't compile against hadoop-common trunk

2014-05-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1518: --- Component/s: Spark Core Spark master doesn't compile against hadoop-common trunk

[jira] [Updated] (SPARK-1518) Spark master doesn't compile against hadoop-common trunk

2014-05-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1518: --- Target Version/s: 1.1.0, 1.0.1 (was: 1.0.1) Spark master doesn't compile against

[jira] [Commented] (SPARK-1961) when data return from map is about 10 kb, reduce(_ + _) would always pending

2014-05-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14012471#comment-14012471 ] Patrick Wendell commented on SPARK-1961: Could you add a bit more information here

[jira] [Updated] (SPARK-1962) Add RDD cache reference counting

2014-05-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1962: --- Component/s: Spark Core Add RDD cache reference counting

[jira] [Resolved] (SPARK-1935) Explicitly add commons-codec 1.5 as a dependency

2014-05-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1935. Resolution: Fixed Explicitly add commons-codec 1.5 as a dependency

[jira] [Updated] (SPARK-1935) Explicitly add commons-codec 1.5 as a dependency

2014-05-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1935: --- Fix Version/s: 1.0.1 1.1.0 Explicitly add commons-codec 1.5 as a

[jira] [Resolved] (SPARK-1820) Make GenerateMimaIgnore @DeveloperApi annotation aware.

2014-05-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1820. Resolution: Fixed Issue resolved by pull request 904

[jira] [Resolved] (SPARK-1566) Consolidate the Spark Programming Guide with tabs for all languages

2014-05-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1566. Resolution: Fixed https://github.com/apache/spark/pull/896 Consolidate the Spark

[jira] [Updated] (SPARK-1971) Update MIMA to compare against Spark 1.0.0

2014-05-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1971: --- Assignee: Prashant Sharma Update MIMA to compare against Spark 1.0.0

[jira] [Commented] (SPARK-1954) Make it easier to get Spark on YARN code to compile in IntelliJ

2014-05-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14014711#comment-14014711 ] Patrick Wendell commented on SPARK-1954: Yeah, why not just set `hadoop.version`

[jira] [Created] (SPARK-1984) Maven build requires SCALA_HOME to be set even though it's not needed

2014-06-01 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1984: -- Summary: Maven build requires SCALA_HOME to be set even though it's not needed Key: SPARK-1984 URL: https://issues.apache.org/jira/browse/SPARK-1984 Project:

[jira] [Updated] (SPARK-1984) Maven build requires SCALA_HOME to be set even though it's not needed

2014-06-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1984: --- Fix Version/s: 1.1.0 Maven build requires SCALA_HOME to be set even though it's not needed

[jira] [Commented] (SPARK-1984) Maven build requires SCALA_HOME to be set even though it's not needed

2014-06-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14015054#comment-14015054 ] Patrick Wendell commented on SPARK-1984: master:

[jira] [Updated] (SPARK-1984) Maven build requires SCALA_HOME to be set even though it's not needed

2014-06-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1984: --- Fix Version/s: (was: 1.0.0) 1.0.1 Maven build requires SCALA_HOME to

[jira] [Updated] (SPARK-1993) Let users skip checking output directory

2014-06-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1993: --- Summary: Let users skip checking output directory (was: Allow users to avoid checking

[jira] [Created] (SPARK-1993) Allow users to avoid checking output directory

2014-06-02 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1993: -- Summary: Allow users to avoid checking output directory Key: SPARK-1993 URL: https://issues.apache.org/jira/browse/SPARK-1993 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-1790) Update EC2 scripts to support r3 instance types

2014-06-03 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14017217#comment-14017217 ] Patrick Wendell edited comment on SPARK-1790 at 6/3/14 10:21 PM:

[jira] [Commented] (SPARK-1790) Update EC2 scripts to support r3 instance types

2014-06-03 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14017217#comment-14017217 ] Patrick Wendell commented on SPARK-1790: Hey [~sujeetv] someone asked me to look

[jira] [Commented] (SPARK-1979) Error message needs to be updated when user specifies --arg ( which is no longer required to run spark submit jobs).Spark documentation needs to be updated to reflect t

2014-06-03 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14017393#comment-14017393 ] Patrick Wendell commented on SPARK-1979: The documentation is up to date. You are

[jira] [Updated] (SPARK-2019) Spark workers die/disappear when job fails for nearly any reason

2014-06-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2019: --- Fix Version/s: 0.9.2 Spark workers die/disappear when job fails for nearly any reason

[jira] [Commented] (SPARK-2019) Spark workers die/disappear when job fails for nearly any reason

2014-06-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14018086#comment-14018086 ] Patrick Wendell commented on SPARK-2019: We should dig into this and figure out

[jira] [Updated] (SPARK-2019) Spark workers die/disappear when job fails for nearly any reason

2014-06-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2019: --- Priority: Critical (was: Major) Spark workers die/disappear when job fails for nearly any

[jira] [Updated] (SPARK-1790) Update EC2 scripts to support r3 instance types

2014-06-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1790: --- Fix Version/s: 1.1.0 0.9.2 Update EC2 scripts to support r3 instance

[jira] [Resolved] (SPARK-1790) Update EC2 scripts to support r3 instance types

2014-06-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1790. Resolution: Fixed Update EC2 scripts to support r3 instance types

[jira] [Updated] (SPARK-2028) Users of HadoopRDD cannot access the partition InputSplits

2014-06-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2028: --- Issue Type: New Feature (was: Bug) Users of HadoopRDD cannot access the partition

[jira] [Commented] (SPARK-2028) Let users of HadoopRDD access the partition InputSplits

2014-06-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14018474#comment-14018474 ] Patrick Wendell commented on SPARK-2028: I wantonly changed this from a Bug to a

[jira] [Updated] (SPARK-2027) spark-ec2 puts Hadoop's log4j ahead of Spark's in classpath

2014-06-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2027: --- Component/s: EC2 spark-ec2 puts Hadoop's log4j ahead of Spark's in classpath

[jira] [Updated] (SPARK-2028) Let users of HadoopRDD access the partition InputSplits

2014-06-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2028: --- Summary: Let users of HadoopRDD access the partition InputSplits (was: Users of HadoopRDD

[jira] [Updated] (SPARK-2019) Spark workers die/disappear when job fails for nearly any reason

2014-06-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2019: --- Description: We either have to reboot all the nodes, or run 'sudo service spark-worker

[jira] [Resolved] (SPARK-2029) Bump pom.xml version number of master branch to 1.1.0-SNAPSHOT.

2014-06-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2029. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 974

[jira] [Resolved] (SPARK-2030) Bump SparkBuild.scala version number of branch-1.0 to 1.0.1-SNAPSHOT.

2014-06-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2030. Resolution: Fixed Fix Version/s: 1.0.1 Issue resolved by pull request 975

[jira] [Resolved] (SPARK-1677) Allow users to avoid Hadoop output checks if desired

2014-06-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1677. Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Issue resolved by

[jira] [Created] (SPARK-2039) Run hadoop output checks for all formats

2014-06-05 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-2039: -- Summary: Run hadoop output checks for all formats Key: SPARK-2039 URL: https://issues.apache.org/jira/browse/SPARK-2039 Project: Spark Issue Type:

[jira] [Created] (SPARK-2040) Support cross-building with Scala 2.11

2014-06-05 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-2040: -- Summary: Support cross-building with Scala 2.11 Key: SPARK-2040 URL: https://issues.apache.org/jira/browse/SPARK-2040 Project: Spark Issue Type:

[jira] [Updated] (SPARK-1812) Support cross-building with Scala 2.11

2014-06-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1812: --- Description: Since Scala 2.10/2.11 are source compatible, we should be able to cross build

[jira] [Updated] (SPARK-1812) Support Scala 2.11

2014-06-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1812: --- Assignee: Prashant Sharma Support Scala 2.11 -- Key:

[jira] [Updated] (SPARK-1812) Support cross-building with Scala 2.11

2014-06-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1812: --- Summary: Support cross-building with Scala 2.11 (was: Support Scala 2.11) Support

[jira] [Updated] (SPARK-1749) DAGScheduler supervisor strategy broken with Mesos

2014-06-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1749: --- Target Version/s: 1.0.1, 1.1.0 (was: 1.0.1) DAGScheduler supervisor strategy broken with

[jira] [Commented] (SPARK-2019) Spark workers die/disappear when job fails for nearly any reason

2014-06-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019449#comment-14019449 ] Patrick Wendell commented on SPARK-2019: Hey @sams - I'm going to temporarily

[jira] [Resolved] (SPARK-2019) Spark workers die/disappear when job fails for nearly any reason

2014-06-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2019. Resolution: Incomplete Spark workers die/disappear when job fails for nearly any reason

[jira] [Created] (SPARK-2061) Deprecate `splits` in JavaRDDLike and add `partitions`

2014-06-06 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-2061: -- Summary: Deprecate `splits` in JavaRDDLike and add `partitions` Key: SPARK-2061 URL: https://issues.apache.org/jira/browse/SPARK-2061 Project: Spark

[jira] [Commented] (SPARK-1841) update scalatest to version 2.1.5

2014-06-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14020635#comment-14020635 ] Patrick Wendell commented on SPARK-1841: This was not fixed in 1.0.1, it was only

[jira] [Commented] (SPARK-2064) web ui should not remove executors if they are dead

2014-06-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14020976#comment-14020976 ] Patrick Wendell commented on SPARK-2064: I don't think OOM is an issue here - but

[jira] [Comment Edited] (SPARK-2064) web ui should not remove executors if they are dead

2014-06-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14020976#comment-14020976 ] Patrick Wendell edited comment on SPARK-2064 at 6/7/14 9:16 PM:

[jira] [Resolved] (SPARK-2056) Set RDD name to input path

2014-06-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2056. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 992

[jira] [Updated] (SPARK-2056) Set RDD name to input path

2014-06-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2056: --- Assignee: Neville Li Set RDD name to input path --

[jira] [Updated] (SPARK-2000) cannot connect to cluster in Standalone mode when run spark-shell in one of the cluster node without specify master

2014-06-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2000: --- Assignee: Chen Chao (was: Guoqiang Li) cannot connect to cluster in Standalone mode when

[jira] [Commented] (SPARK-2000) cannot connect to cluster in Standalone mode when run spark-shell in one of the cluster node without specify master

2014-06-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14021147#comment-14021147 ] Patrick Wendell commented on SPARK-2000: [~crazyjvm] I had no idea we actually

[jira] [Updated] (SPARK-1154) Spark fills up disk with app-* folders

2014-06-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1154: --- Assignee: Mingyu Kim (was: Evan Chan) Spark fills up disk with app-* folders

[jira] [Resolved] (SPARK-2026) Maven hadoop* Profiles Should Set the expected Hadoop Version.

2014-06-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2026. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 998

[jira] [Updated] (SPARK-2026) Maven hadoop* Profiles Should Set the expected Hadoop Version.

2014-06-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2026: --- Assignee: Bernardo Gomez Palacio Maven hadoop* Profiles Should Set the expected Hadoop

[jira] [Created] (SPARK-2070) Package private methods are not excluded correctly

2014-06-08 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-2070: -- Summary: Package private methods are not excluded correctly Key: SPARK-2070 URL: https://issues.apache.org/jira/browse/SPARK-2070 Project: Spark Issue

[jira] [Updated] (SPARK-2070) Package private methods are not excluded correctly

2014-06-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2070: --- Description: {code} [error] * method getCallSite()java.lang.String in class

[jira] [Created] (SPARK-2071) Package private classes that are deleted from an older version of Spark trigger errors

2014-06-08 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-2071: -- Summary: Package private classes that are deleted from an older version of Spark trigger errors Key: SPARK-2071 URL: https://issues.apache.org/jira/browse/SPARK-2071

[jira] [Updated] (SPARK-2069) MIMA false positives (umbrella)

2014-06-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2069: --- Priority: Critical (was: Major) MIMA false positives (umbrella)

[jira] [Updated] (SPARK-1898) In deploy.yarn.Client, use YarnClient rather than YarnClientImpl

2014-06-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1898: --- Fix Version/s: 1.1.0 In deploy.yarn.Client, use YarnClient rather than YarnClientImpl

[jira] [Resolved] (SPARK-1898) In deploy.yarn.Client, use YarnClient rather than YarnClientImpl

2014-06-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1898. Resolution: Fixed https://github.com/apache/spark/pull/850 In deploy.yarn.Client, use

[jira] [Updated] (SPARK-1898) In deploy.yarn.Client, use YarnClient rather than YarnClientImpl

2014-06-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1898: --- Component/s: YARN In deploy.yarn.Client, use YarnClient rather than YarnClientImpl

[jira] [Updated] (SPARK-1898) In deploy.yarn.Client, use YarnClient rather than YarnClientImpl

2014-06-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1898: --- Assignee: Colin Patrick McCabe In deploy.yarn.Client, use YarnClient rather than

[jira] [Commented] (SPARK-2075) Hadoop1 distribution of 1.0.0 does not contain classes expected by the Maven 1.0.0 artifact

2014-06-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14021465#comment-14021465 ] Patrick Wendell commented on SPARK-2075: Okay I did some more digging. I think the

[jira] [Comment Edited] (SPARK-2075) Hadoop1 distribution of 1.0.0 does not contain classes expected by the Maven 1.0.0 artifact

2014-06-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14021465#comment-14021465 ] Patrick Wendell edited comment on SPARK-2075 at 6/8/14 10:13 PM:

[jira] [Updated] (SPARK-2057) run-example can only be run within spark_home

2014-06-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2057: --- Component/s: Spark Core run-example can only be run within spark_home

[jira] [Updated] (SPARK-2057) run-example can only be run within spark_home

2014-06-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2057: --- Fix Version/s: 1.0.1 run-example can only be run within spark_home

[jira] [Commented] (SPARK-2057) run-example can only be run within spark_home

2014-06-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14021467#comment-14021467 ] Patrick Wendell commented on SPARK-2057: Fixed via this patch:

<    1   2   3   4   5   6   7   8   9   10   >