[jira] [Updated] (SPARK-1441) Compile Spark Core error with Hadoop 0.23.x when not using YARN

[ https://issues.apache.org/jira/browse/SPARK-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1441: --- Assignee: Guoqiang Li Compile Spark Core error with Hadoop 0.23.x when not using YARN

[jira] [Commented] (SPARK-1491) maven hadoop-provided profile fails to build

[ https://issues.apache.org/jira/browse/SPARK-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984069#comment-13984069 ] Patrick Wendell commented on SPARK-1491: Fixed by :

[jira] [Updated] (SPARK-1100) saveAsTextFile shouldn't clobber by default

[ https://issues.apache.org/jira/browse/SPARK-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1100: --- Assignee: Patrick Wendell (was: Patrick Cogan) saveAsTextFile shouldn't clobber by default

[jira] [Resolved] (SPARK-1588) SPARK_JAVA_OPTS and SPARK_YARN_USER_ENV are not getting propagated

[ https://issues.apache.org/jira/browse/SPARK-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1588. Resolution: Fixed Fix Version/s: 1.0.0 SPARK_JAVA_OPTS and SPARK_YARN_USER_ENV are

[jira] [Updated] (SPARK-1677) Allow users to avoid Hadoop output checks if desired

[ https://issues.apache.org/jira/browse/SPARK-1677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1677: --- Description: For compatibility with older versions of Spark it would be nice to have an

[jira] [Created] (SPARK-1677) Allow users to avoid Hadoop output checks if desired

Patrick Wendell created SPARK-1677: -- Summary: Allow users to avoid Hadoop output checks if desired Key: SPARK-1677 URL: https://issues.apache.org/jira/browse/SPARK-1677 Project: Spark Issue

[jira] [Resolved] (SPARK-1004) PySpark on YARN

[ https://issues.apache.org/jira/browse/SPARK-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1004. Resolution: Fixed Issue resolved by pull request 30

[jira] [Resolved] (SPARK-1626) Update Spark YARN docs to use spark-submit

[ https://issues.apache.org/jira/browse/SPARK-1626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1626. Resolution: Duplicate Update Spark YARN docs to use spark-submit

[jira] [Updated] (SPARK-1492) running-on-yarn doc should use spark-submit script for examples

[ https://issues.apache.org/jira/browse/SPARK-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1492: --- Priority: Blocker (was: Major) running-on-yarn doc should use spark-submit script for

[jira] [Updated] (SPARK-1466) Pyspark doesn't check if gateway process launches correctly

[ https://issues.apache.org/jira/browse/SPARK-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1466: --- Fix Version/s: (was: 1.0.0) 1.0.1 Pyspark doesn't check if gateway

[jira] [Updated] (SPARK-922) Update Spark AMI to Python 2.7

[ https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-922: -- Fix Version/s: (was: 1.0.0) 1.1.0 Update Spark AMI to Python 2.7

[jira] [Updated] (SPARK-922) Update Spark AMI to Python 2.7

[ https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-922: -- Priority: Major (was: Blocker) Update Spark AMI to Python 2.7 --

[jira] [Commented] (SPARK-922) Update Spark AMI to Python 2.7

[ https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13985219#comment-13985219 ] Patrick Wendell commented on SPARK-922: --- This is no longer a blocker now that we've

[jira] [Resolved] (SPARK-1629) Spark should inline use of commons-lang `SystemUtils.IS_OS_WINDOWS`

[ https://issues.apache.org/jira/browse/SPARK-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1629. Resolution: Fixed Fix Version/s: 1.0.0 Thanks for this fix Spark should inline

[jira] [Created] (SPARK-1683) Display filesystem read statistics with each task

Patrick Wendell created SPARK-1683: -- Summary: Display filesystem read statistics with each task Key: SPARK-1683 URL: https://issues.apache.org/jira/browse/SPARK-1683 Project: Spark Issue

[jira] [Created] (SPARK-1684) Merge script should standardize SPARK-XXX prefix

Patrick Wendell created SPARK-1684: -- Summary: Merge script should standardize SPARK-XXX prefix Key: SPARK-1684 URL: https://issues.apache.org/jira/browse/SPARK-1684 Project: Spark Issue

[jira] [Updated] (SPARK-1684) Merge script should standardize SPARK-XXX prefix

[ https://issues.apache.org/jira/browse/SPARK-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1684: --- Description: If users write [SPARK-XXX] Issue or SPARK-XXX. Issue or SPARK XXX: Issue we

[jira] [Commented] (SPARK-1684) Merge script should standardize SPARK-XXX prefix

[ https://issues.apache.org/jira/browse/SPARK-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13985796#comment-13985796 ] Patrick Wendell commented on SPARK-1684: Just a typo in the description! SPARK-XXX

[jira] [Updated] (SPARK-1691) Support quoted arguments inside of spark-submit

[ https://issues.apache.org/jira/browse/SPARK-1691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1691: --- Description: Currently due to the way we send arguments on to spark-class, it doesn't work

[jira] [Created] (SPARK-1691) Support quoted arguments inside of spark-submit

Patrick Wendell created SPARK-1691: -- Summary: Support quoted arguments inside of spark-submit Key: SPARK-1691 URL: https://issues.apache.org/jira/browse/SPARK-1691 Project: Spark Issue

[jira] [Resolved] (SPARK-1691) Support quoted arguments inside of spark-submit

[ https://issues.apache.org/jira/browse/SPARK-1691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1691. Resolution: Fixed Issue resolved by pull request 609

[jira] [Commented] (SPARK-1693) Dependent on multiple versions of servlet-api jars lead to throw an SecurityException when Spark built for hadoop 2.3.0 , 2.4.0

[ https://issues.apache.org/jira/browse/SPARK-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13987316#comment-13987316 ] Patrick Wendell commented on SPARK-1693: I'm confused about something [~sowen]: If

[jira] [Updated] (SPARK-1693) Dependent on multiple versions of servlet-api jars lead to throw an SecurityException when Spark built for hadoop 2.3.0 , 2.4.0

[ https://issues.apache.org/jira/browse/SPARK-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1693: --- Priority: Blocker (was: Major) Dependent on multiple versions of servlet-api jars lead to

[jira] [Updated] (SPARK-1693) Dependent on multiple versions of servlet-api jars lead to throw an SecurityException when Spark built for hadoop 2.3.0 , 2.4.0

[ https://issues.apache.org/jira/browse/SPARK-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1693: --- Fix Version/s: 1.0.0 Dependent on multiple versions of servlet-api jars lead to throw an

[jira] [Resolved] (SPARK-1695) java8-tests compiler error: package com.google.common.collections does not exist

[ https://issues.apache.org/jira/browse/SPARK-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1695. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 611

[jira] [Updated] (SPARK-1556) jets3t dep doesn't update properly with newer Hadoop versions

[ https://issues.apache.org/jira/browse/SPARK-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1556: --- Summary: jets3t dep doesn't update properly with newer Hadoop versions (was: jets3t

[jira] [Created] (SPARK-1703) Warn users if Spark is run on JRE6 but compiled with JDK7

Patrick Wendell created SPARK-1703: -- Summary: Warn users if Spark is run on JRE6 but compiled with JDK7 Key: SPARK-1703 URL: https://issues.apache.org/jira/browse/SPARK-1703 Project: Spark

[jira] [Updated] (SPARK-1663) Spark Streaming docs code has several small errors

[ https://issues.apache.org/jira/browse/SPARK-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1663: --- Assignee: Sean Owen Spark Streaming docs code has several small errors

[jira] [Resolved] (SPARK-1663) Spark Streaming docs code has several small errors

[ https://issues.apache.org/jira/browse/SPARK-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1663. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 589

[jira] [Updated] (SPARK-1701) Inconsistent naming: slice or partition

[ https://issues.apache.org/jira/browse/SPARK-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1701: --- Component/s: Spark Core Documentation Inconsistent naming: slice or

[jira] [Resolved] (SPARK-1689) AppClient does not respond correctly to RemoveApplication

[ https://issues.apache.org/jira/browse/SPARK-1689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1689. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 605

[jira] [Updated] (SPARK-1706) Allow multiple executors per worker in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1706: --- Component/s: (was: Spark Core) Deploy Allow multiple executors per

[jira] [Resolved] (SPARK-1705) Allow multiple instances per node with SPARK-EC2

[ https://issues.apache.org/jira/browse/SPARK-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1705. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 612

[jira] [Updated] (SPARK-1705) Allow multiple instances per node with SPARK-EC2

[ https://issues.apache.org/jira/browse/SPARK-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1705: --- Assignee: Allan Douglas R. de Oliveira Allow multiple instances per node with SPARK-EC2

[jira] [Resolved] (SPARK-1658) Correctly identify if maven is installed and working

[ https://issues.apache.org/jira/browse/SPARK-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1658. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 580

[jira] [Resolved] (SPARK-1703) Warn users if Spark is run on JRE6 but compiled with JDK7

[ https://issues.apache.org/jira/browse/SPARK-1703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1703. Resolution: Fixed Issue resolved by pull request 627

[jira] [Resolved] (SPARK-1520) Assembly Jar with more than 65536 files won't work when compiled on JDK7 and run on JDK6

[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1520. Resolution: Unresolved There is no known resolution for this problem. We've updated the

[jira] [Updated] (SPARK-1703) Warn users if Spark is run on JRE6 but compiled with JDK7

[ https://issues.apache.org/jira/browse/SPARK-1703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1703: --- Assignee: Patrick Wendell Warn users if Spark is run on JRE6 but compiled with JDK7

[jira] [Resolved] (SPARK-1693) Dependent on multiple versions of servlet-api jars lead to throw an SecurityException when Spark built for hadoop 2.3.0 , 2.4.0

[ https://issues.apache.org/jira/browse/SPARK-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1693. Resolution: Fixed Issue resolved by pull request 628

[jira] [Updated] (SPARK-1716) EC2 script should exit with non-zero code on UsageError

[ https://issues.apache.org/jira/browse/SPARK-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1716: --- Assignee: Allan Douglas R. de Oliveira EC2 script should exit with non-zero code on

[jira] [Resolved] (SPARK-1716) EC2 script should exit with non-zero code on UsageError

[ https://issues.apache.org/jira/browse/SPARK-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1716. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 638

[jira] [Resolved] (SPARK-1710) spark-submit should print better errors than InvocationTargetException

[ https://issues.apache.org/jira/browse/SPARK-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1710. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 630

[jira] [Resolved] (SPARK-1717) spark-ec2.py sometimes doesn't wait long enough for EC2 to stand up

[ https://issues.apache.org/jira/browse/SPARK-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1717. Resolution: Fixed Issue resolved by pull request 641

[jira] [Created] (SPARK-1721) Classloaders not used correctly in Mesos

Patrick Wendell created SPARK-1721: -- Summary: Classloaders not used correctly in Mesos Key: SPARK-1721 URL: https://issues.apache.org/jira/browse/SPARK-1721 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-1721) Classloaders not used correctly in Mesos

[ https://issues.apache.org/jira/browse/SPARK-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1721: --- Priority: Blocker (was: Major) Classloaders not used correctly in Mesos

[jira] [Updated] (SPARK-1721) Classloaders not used correctly in Mesos

[ https://issues.apache.org/jira/browse/SPARK-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1721: --- Assignee: Bouke van der Bijl Classloaders not used correctly in Mesos

[jira] [Resolved] (SPARK-1556) jets3t dep doesn't update properly with newer Hadoop versions

[ https://issues.apache.org/jira/browse/SPARK-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1556. Resolution: Fixed Issue resolved by pull request 629

[jira] [Updated] (SPARK-1556) jets3t dep doesn't update properly with newer Hadoop versions

[ https://issues.apache.org/jira/browse/SPARK-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1556: --- Assignee: Sean Owen (was: Nan Zhu) jets3t dep doesn't update properly with newer Hadoop

[jira] [Resolved] (SPARK-1721) Classloaders not used correctly in Mesos

[ https://issues.apache.org/jira/browse/SPARK-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1721. Resolution: Fixed Fixed by: https://github.com/apache/spark/pull/620 Classloaders not

[jira] [Resolved] (SPARK-1681) Handle hive support correctly in ./make-distribution

[ https://issues.apache.org/jira/browse/SPARK-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1681. Resolution: Fixed Handle hive support correctly in ./make-distribution

[jira] [Commented] (SPARK-1681) Handle hive support correctly in ./make-distribution

[ https://issues.apache.org/jira/browse/SPARK-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13990084#comment-13990084 ] Patrick Wendell commented on SPARK-1681: Closed via:

[jira] [Updated] (SPARK-1714) Take advantage of AMRMClient APIs to simplify logic in YarnAllocationHandler

[ https://issues.apache.org/jira/browse/SPARK-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1714: --- Fix Version/s: 1.1.0 Take advantage of AMRMClient APIs to simplify logic in

[jira] [Resolved] (SPARK-1728) JavaRDDLike.mapPartitionsWithIndex requires ClassTag

[ https://issues.apache.org/jira/browse/SPARK-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1728. Resolution: Fixed Issue resolved by pull request 657

[jira] [Resolved] (SPARK-1678) Compression loses repeated values.

[ https://issues.apache.org/jira/browse/SPARK-1678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1678. Resolution: Fixed Issue resolved by pull request 608

[jira] [Resolved] (SPARK-1735) Make distribution script has missing profiles for special hadoop versions

[ https://issues.apache.org/jira/browse/SPARK-1735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1735. Resolution: Fixed Issue resolved by pull request 660

[jira] [Commented] (SPARK-1734) spark-submit throws an exception: Exception in thread main java.lang.ClassNotFoundException: org.apache.spark.broadcast.TorrentBroadcastFactory

[ https://issues.apache.org/jira/browse/SPARK-1734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13990359#comment-13990359 ] Patrick Wendell commented on SPARK-1734: This is pretty strange, I would think

[jira] [Created] (SPARK-1739) Close PR's after 30 days of inactivity

Patrick Wendell created SPARK-1739: -- Summary: Close PR's after 30 days of inactivity Key: SPARK-1739 URL: https://issues.apache.org/jira/browse/SPARK-1739 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-1712) ParallelCollectionRDD operations hanging forever without any error messages

[ https://issues.apache.org/jira/browse/SPARK-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13990960#comment-13990960 ] Patrick Wendell commented on SPARK-1712: We should probably add a check that the

[jira] [Resolved] (SPARK-1474) Spark on yarn assembly doesn't include org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter

[ https://issues.apache.org/jira/browse/SPARK-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1474. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 406

[jira] [Resolved] (SPARK-1679) In-Memory compression needs to be configurable.

[ https://issues.apache.org/jira/browse/SPARK-1679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1679. Resolution: Fixed In-Memory compression needs to be configurable.

[jira] [Resolved] (SPARK-1118) Executor state shows as KILLED even the application is finished normally

[ https://issues.apache.org/jira/browse/SPARK-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1118. Resolution: Duplicate Executor state shows as KILLED even the application is finished

[jira] [Commented] (SPARK-1737) unable to make-distribution for mesos with JDK 1.7

[ https://issues.apache.org/jira/browse/SPARK-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13991015#comment-13991015 ] Patrick Wendell commented on SPARK-1737: Even though SPARK-1703 adds logging, once

[jira] [Updated] (SPARK-1118) Executor state shows as KILLED even the application is finished normally

[ https://issues.apache.org/jira/browse/SPARK-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1118: --- Priority: Minor (was: Critical) Executor state shows as KILLED even the application is

[jira] [Updated] (SPARK-1737) unable to make-distribution for mesos with JDK 1.7

[ https://issues.apache.org/jira/browse/SPARK-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1737: --- Description: the merged PR for SPARK-1703 made it so that make-distribution.sh will never

[jira] [Updated] (SPARK-1737) unable to make-distribution for mesos with JDK 1.7

[ https://issues.apache.org/jira/browse/SPARK-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1737: --- Description: the merged PR for SPARK-1703 made it so that make-distribution.sh will never

[jira] [Commented] (SPARK-1737) unable to make-distribution for mesos with JDK 1.7

[ https://issues.apache.org/jira/browse/SPARK-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13991134#comment-13991134 ] Patrick Wendell commented on SPARK-1737: Yes let's actually make this more tame.

[jira] [Commented] (SPARK-1737) unable to make-distribution for mesos with JDK 1.7

[ https://issues.apache.org/jira/browse/SPARK-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13991144#comment-13991144 ] Patrick Wendell commented on SPARK-1737:

[jira] [Resolved] (SPARK-1734) spark-submit throws an exception: Exception in thread main java.lang.ClassNotFoundException: org.apache.spark.broadcast.TorrentBroadcastFactory

[ https://issues.apache.org/jira/browse/SPARK-1734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1734. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 665

[jira] [Commented] (SPARK-1737) unable to make-distribution for mesos with JDK 1.7

[ https://issues.apache.org/jira/browse/SPARK-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13991146#comment-13991146 ] Patrick Wendell commented on SPARK-1737: The only problem is if Spark is built

[jira] [Commented] (SPARK-1737) unable to make-distribution for mesos with JDK 1.7

[ https://issues.apache.org/jira/browse/SPARK-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13991134#comment-13991134 ] Patrick Wendell commented on SPARK-1737: Yes let's actually make this more tame.

[jira] [Assigned] (SPARK-1737) Warn rather than fail when Java 7+ is used to create distributions

[ https://issues.apache.org/jira/browse/SPARK-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-1737: -- Assignee: Patrick Wendell Warn rather than fail when Java 7+ is used to create

[jira] [Resolved] (SPARK-1737) Warn rather than fail when Java 7+ is used to create distributions

[ https://issues.apache.org/jira/browse/SPARK-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1737. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 669

[jira] [Created] (SPARK-1746) Support setting SPARK_JAVA_OPTS on executors for backwards compatibility

Patrick Wendell created SPARK-1746: -- Summary: Support setting SPARK_JAVA_OPTS on executors for backwards compatibility Key: SPARK-1746 URL: https://issues.apache.org/jira/browse/SPARK-1746 Project:

[jira] [Commented] (SPARK-1637) Clean up examples for 1.0

[ https://issues.apache.org/jira/browse/SPARK-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13991541#comment-13991541 ] Patrick Wendell commented on SPARK-1637: There was a follow on for this also:

[jira] [Resolved] (SPARK-1746) Support setting SPARK_JAVA_OPTS on executors for backwards compatibility

[ https://issues.apache.org/jira/browse/SPARK-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1746. Resolution: Fixed Closed via https://github.com/apache/spark/pull/676 Support setting

[jira] [Resolved] (SPARK-1631) App name set in SparkConf (not in JVM properties) not respected by Yarn backend

[ https://issues.apache.org/jira/browse/SPARK-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1631. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 539

[jira] [Created] (SPARK-1776) Have Spark's SBT build read dependencies from Maven

Patrick Wendell created SPARK-1776: -- Summary: Have Spark's SBT build read dependencies from Maven Key: SPARK-1776 URL: https://issues.apache.org/jira/browse/SPARK-1776 Project: Spark Issue

[jira] [Commented] (SPARK-1725) Can't use broadcast variables in pyspark on Mesos because pyspark isn't added to PYTHONPATH

[ https://issues.apache.org/jira/browse/SPARK-1725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13993358#comment-13993358 ] Patrick Wendell commented on SPARK-1725: Closed via:

[jira] [Resolved] (SPARK-1755) Spark-submit --name does not resolve to application name on YARN

[ https://issues.apache.org/jira/browse/SPARK-1755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1755. Resolution: Fixed Issue resolved by pull request 699

[jira] [Updated] (SPARK-1754) Add missing arithmetic DSL operations.

[ https://issues.apache.org/jira/browse/SPARK-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1754: --- Assignee: Takuya Ueshin Add missing arithmetic DSL operations.

[jira] [Resolved] (SPARK-1725) Can't use broadcast variables in pyspark on Mesos because pyspark isn't added to PYTHONPATH

[ https://issues.apache.org/jira/browse/SPARK-1725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1725. Resolution: Fixed Fix Version/s: 1.0.0 Can't use broadcast variables in pyspark on

[jira] [Created] (SPARK-1773) Standalone cluster docs should be updated to reflect Spark Submit

Patrick Wendell created SPARK-1773: -- Summary: Standalone cluster docs should be updated to reflect Spark Submit Key: SPARK-1773 URL: https://issues.apache.org/jira/browse/SPARK-1773 Project: Spark

[jira] [Updated] (SPARK-1776) Have Spark's SBT build read dependencies from Maven

[ https://issues.apache.org/jira/browse/SPARK-1776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1776: --- Description: We've wanted to consolidate Spark's build for a while see

[jira] [Updated] (SPARK-1775) Unneeded lock in ShuffleMapTask.deserializeInfo

[ https://issues.apache.org/jira/browse/SPARK-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1775: --- Assignee: Sandeep Singh Unneeded lock in ShuffleMapTask.deserializeInfo

[jira] [Updated] (SPARK-1755) Spark-submit --name does not resolve to application name on YARN

[ https://issues.apache.org/jira/browse/SPARK-1755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1755: --- Priority: Blocker (was: Major) Spark-submit --name does not resolve to application name on

[jira] [Created] (SPARK-1777) Pass cached blocks directly to disk if memory is not large enough

Patrick Wendell created SPARK-1777: -- Summary: Pass cached blocks directly to disk if memory is not large enough Key: SPARK-1777 URL: https://issues.apache.org/jira/browse/SPARK-1777 Project: Spark

[jira] [Updated] (SPARK-571) Forbid return statements when cleaning closures

[ https://issues.apache.org/jira/browse/SPARK-571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-571: -- Assignee: William Benton Forbid return statements when cleaning closures

[jira] [Commented] (SPARK-1770) repartition and coalesce(shuffle=true) put objects with the same key in the same bucket

[ https://issues.apache.org/jira/browse/SPARK-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994352#comment-13994352 ] Patrick Wendell commented on SPARK-1770: It was a mistake on my part - I

[jira] [Resolved] (SPARK-1789) Multiple versions of Netty dependencies cause FlumeStreamSuite failure

[ https://issues.apache.org/jira/browse/SPARK-1789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1789. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 723

[jira] [Updated] (SPARK-1789) Multiple versions of Netty dependencies cause FlumeStreamSuite failure

[ https://issues.apache.org/jira/browse/SPARK-1789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1789: --- Assignee: Sean Owen Multiple versions of Netty dependencies cause FlumeStreamSuite failure

[jira] [Resolved] (SPARK-1774) SparkSubmit --jars not working for yarn-client

[ https://issues.apache.org/jira/browse/SPARK-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1774. Resolution: Fixed Issue resolved by pull request 710

[jira] [Resolved] (SPARK-1756) Add missing description to spark-env.sh.template

[ https://issues.apache.org/jira/browse/SPARK-1756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1756. Resolution: Won't Fix This option is deprecated now and has been replaced by setting

[jira] [Created] (SPARK-1796) spark-submit does not set driver memory correctly

Patrick Wendell created SPARK-1796: -- Summary: spark-submit does not set driver memory correctly Key: SPARK-1796 URL: https://issues.apache.org/jira/browse/SPARK-1796 Project: Spark Issue

[jira] [Resolved] (SPARK-1770) repartition and coalesce(shuffle=true) put objects with the same key in the same bucket

[ https://issues.apache.org/jira/browse/SPARK-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1770. Resolution: Fixed repartition and coalesce(shuffle=true) put objects with the same key in

[jira] [Resolved] (SPARK-1565) Spark examples should be changed given spark-submit

[ https://issues.apache.org/jira/browse/SPARK-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1565. Resolution: Fixed Issue resolved by pull request 552

[jira] [Updated] (SPARK-1774) SparkSubmit --jars not working for yarn-client

[ https://issues.apache.org/jira/browse/SPARK-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1774: --- Assignee: Andrew Or SparkSubmit --jars not working for yarn-client

[jira] [Comment Edited] (SPARK-1792) Missing Spark-Shell Configure Options

[ https://issues.apache.org/jira/browse/SPARK-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994800#comment-13994800 ] Patrick Wendell edited comment on SPARK-1792 at 5/12/14 4:49 AM:

[jira] [Updated] (SPARK-1802) Audit dependency graph when Spark is built with -Phive

[ https://issues.apache.org/jira/browse/SPARK-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1802: --- Description: I'd like to have binary release for 1.0 include Hive support. Since this isn't

[jira] [Updated] (SPARK-1802) Audit dependency graph when Spark is built with -Phive

[ https://issues.apache.org/jira/browse/SPARK-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1802: --- Description: I'd like to have binary release for 1.0 include Hive support. Since this isn't

[jira] [Resolved] (SPARK-1772) Spark executors do not successfully die on OOM

[ https://issues.apache.org/jira/browse/SPARK-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1772. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 715

<    1   2   3   4   5   6   7   8   9   10   >