[jira] [Created] (SPARK-1825) Windows Spark fails to work with Linux YARN

Taeyun Kim created SPARK-1825: - Summary: Windows Spark fails to work with Linux YARN Key: SPARK-1825 URL: https://issues.apache.org/jira/browse/SPARK-1825 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-1822) SchemaRDD.count() should use the optimizer.

Michael Armbrust created SPARK-1822: --- Summary: SchemaRDD.count() should use the optimizer. Key: SPARK-1822 URL: https://issues.apache.org/jira/browse/SPARK-1822 Project: Spark Issue Type: I

[jira] [Updated] (SPARK-1825) Windows Spark fails to work with Linux YARN

[ https://issues.apache.org/jira/browse/SPARK-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Taeyun Kim updated SPARK-1825: -- Fix Version/s: 1.0.0 > Windows Spark fails to work with Linux YARN > --

[jira] [Commented] (SPARK-1770) repartition and coalesce(shuffle=true) put objects with the same key in the same bucket

[ https://issues.apache.org/jira/browse/SPARK-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13993917#comment-13993917 ] Aaron Davidson commented on SPARK-1770: --- Sorry, you're right, it was somehow committ

[jira] [Commented] (SPARK-1283) Create spark-contrib repo for 1.0

[ https://issues.apache.org/jira/browse/SPARK-1283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13993076#comment-13993076 ] Patrick Wendell commented on SPARK-1283: [~velvia] Yeah - do you want to submit a

[jira] [Updated] (SPARK-1708) Add ClassTag parameter on accumulator and broadcast methods

[ https://issues.apache.org/jira/browse/SPARK-1708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1708: --- Fix Version/s: (was: 1.1.0) 1.0.0 > Add ClassTag parameter on accumula

[jira] [Updated] (SPARK-1787) Build failure on JDK8 :: SBT fails to load build configuration file

[ https://issues.apache.org/jira/browse/SPARK-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Gomes updated SPARK-1787: - Description: SBT fails to build under JDK8. Please find steps to reproduce the error below: (j8

[jira] [Commented] (SPARK-1816) LiveListenerBus dies if a listener throws an exception

[ https://issues.apache.org/jira/browse/SPARK-1816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997078#comment-13997078 ] Andrew Or commented on SPARK-1816: -- https://github.com/apache/spark/pull/759 > LiveListe

[jira] [Created] (SPARK-1769) Executor loss can cause race condition in Pool

Aaron Davidson created SPARK-1769: - Summary: Executor loss can cause race condition in Pool Key: SPARK-1769 URL: https://issues.apache.org/jira/browse/SPARK-1769 Project: Spark Issue Type: Bu

[jira] [Created] (SPARK-1824) Python examples still take in

Andrew Or created SPARK-1824: Summary: Python examples still take in Key: SPARK-1824 URL: https://issues.apache.org/jira/browse/SPARK-1824 Project: Spark Issue Type: Bug Reporter: An

[jira] [Updated] (SPARK-1824) Python examples still take in

[ https://issues.apache.org/jira/browse/SPARK-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1824: - Affects Version/s: 1.0.0 > Python examples still take in > -- > >

[jira] [Created] (SPARK-1826) Some bad head notations in sparksql

wangfei created SPARK-1826: -- Summary: Some bad head notations in sparksql Key: SPARK-1826 URL: https://issues.apache.org/jira/browse/SPARK-1826 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-1769) Executor loss can cause race condition in Pool

[ https://issues.apache.org/jira/browse/SPARK-1769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997079#comment-13997079 ] Andrew Or commented on SPARK-1769: -- https://github.com/apache/spark/pull/762 > Executor

[jira] [Resolved] (SPARK-1527) rootDirs in DiskBlockManagerSuite doesn't get full path from rootDir0, rootDir1

[ https://issues.apache.org/jira/browse/SPARK-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1527. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 436 [https://g

[jira] [Resolved] (SPARK-1816) LiveListenerBus dies if a listener throws an exception

[ https://issues.apache.org/jira/browse/SPARK-1816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1816. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 759 [https://g

[jira] [Updated] (SPARK-1823) ExternalAppendOnlyMap can still OOM if one key is very large

[ https://issues.apache.org/jira/browse/SPARK-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1823: - Affects Version/s: 1.0.0 > ExternalAppendOnlyMap can still OOM if one key is very large > ---

[jira] [Resolved] (SPARK-1793) Heavily duplicated test setup code in SVMSuite

[ https://issues.apache.org/jira/browse/SPARK-1793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Tulloch resolved SPARK-1793. --- Resolution: Fixed Fix Version/s: 1.0.0 > Heavily duplicated test setup code in SVMSuit

[jira] [Assigned] (SPARK-1780) Non-existent SPARK_DAEMON_OPTS is referred to in a few places

[ https://issues.apache.org/jira/browse/SPARK-1780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-1780: -- Assignee: Patrick Wendell > Non-existent SPARK_DAEMON_OPTS is referred to in a few plac

[jira] [Updated] (SPARK-1753) PySpark on YARN does not work on assembly jar built on Red Hat based OS

[ https://issues.apache.org/jira/browse/SPARK-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1753: --- Assignee: Andrew Or > PySpark on YARN does not work on assembly jar built on Red Hat based OS

[jira] [Updated] (SPARK-1736) spark-submit on Windows

[ https://issues.apache.org/jira/browse/SPARK-1736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1736: --- Assignee: Andrew Or > spark-submit on Windows > --- > > K

[jira] [Resolved] (SPARK-571) Forbid return statements when cleaning closures

[ https://issues.apache.org/jira/browse/SPARK-571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-571. --- Resolution: Fixed > Forbid return statements when cleaning closures >

[jira] [Created] (SPARK-1779) Warning when spark.storage.memoryFraction is not between 0 and 1

wangfei created SPARK-1779: -- Summary: Warning when spark.storage.memoryFraction is not between 0 and 1 Key: SPARK-1779 URL: https://issues.apache.org/jira/browse/SPARK-1779 Project: Spark Issue Typ

[jira] [Commented] (SPARK-1283) Create spark-contrib repo for 1.0

[ https://issues.apache.org/jira/browse/SPARK-1283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13992974#comment-13992974 ] Evan Chan commented on SPARK-1283: -- Any more comments? Objections to creating a landin

[jira] [Resolved] (SPARK-1708) Add ClassTag parameter on accumulator and broadcast methods

[ https://issues.apache.org/jira/browse/SPARK-1708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1708. Resolution: Fixed Fix Version/s: (was: 1.0.0) 1.1.0 Issue res

[jira] [Updated] (SPARK-571) Forbid return statements when cleaning closures

[ https://issues.apache.org/jira/browse/SPARK-571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-571: -- Fix Version/s: 1.1.0 > Forbid return statements when cleaning closures > ---

[jira] [Updated] (SPARK-1817) RDD zip erroneous when partitions do not divide RDD count

[ https://issues.apache.org/jira/browse/SPARK-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kan Zhang updated SPARK-1817: - Affects Version/s: 1.0.0 > RDD zip erroneous when partitions do not divide RDD count > --

[jira] [Updated] (SPARK-1817) RDD zip erroneous when partitions do not divide RDD count

[ https://issues.apache.org/jira/browse/SPARK-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kan Zhang updated SPARK-1817: - Component/s: Spark Core > RDD zip erroneous when partitions do not divide RDD count > ---

[jira] [Commented] (SPARK-1789) Multiple versions of Netty dependencies cause FlumeStreamSuite failure

[ https://issues.apache.org/jira/browse/SPARK-1789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13995560#comment-13995560 ] William Benton commented on SPARK-1789: --- Sean, we're currently building against Akka

[jira] [Commented] (SPARK-1802) Audit dependency graph when Spark is built with -Phive

[ https://issues.apache.org/jira/browse/SPARK-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996278#comment-13996278 ] Sean Owen commented on SPARK-1802: -- First, I apologize, I misspoke above. Actually hive-e

[jira] [Updated] (SPARK-1813) Add a utility to SparkConf that makes using Kryo really easy

[ https://issues.apache.org/jira/browse/SPARK-1813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-1813: -- Description: It would be nice to have a method in SparkConf that makes it really easy to turn on Kryo

[jira] [Updated] (SPARK-1821) Document History Server

[ https://issues.apache.org/jira/browse/SPARK-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu updated SPARK-1821: --- Issue Type: Improvement (was: Bug) > Document History Server > --- > > K

[jira] [Created] (SPARK-1821) Document History Server

Nan Zhu created SPARK-1821: -- Summary: Document History Server Key: SPARK-1821 URL: https://issues.apache.org/jira/browse/SPARK-1821 Project: Spark Issue Type: Bug Components: Deploy Af

[jira] [Commented] (SPARK-1817) RDD zip erroneous when partitions do not divide RDD count

[ https://issues.apache.org/jira/browse/SPARK-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996818#comment-13996818 ] Kan Zhang commented on SPARK-1817: -- PR: https://github.com/apache/spark/pull/760 > RDD z

[jira] [Assigned] (SPARK-1769) Executor loss can cause race condition in Pool

[ https://issues.apache.org/jira/browse/SPARK-1769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson reassigned SPARK-1769: - Assignee: Aaron Davidson > Executor loss can cause race condition in Pool > -

[jira] [Updated] (SPARK-1769) Executor loss can cause race condition in Pool

[ https://issues.apache.org/jira/browse/SPARK-1769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson updated SPARK-1769: -- Assignee: Andrew Or (was: Aaron Davidson) > Executor loss can cause race condition in Pool > -

[jira] [Updated] (SPARK-1813) Add a utility to SparkConf that makes using Kryo really easy

[ https://issues.apache.org/jira/browse/SPARK-1813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-1813: -- Description: It would be nice to have a method in SparkConf that makes it really easy to turn on Kryo

[jira] [Commented] (SPARK-1779) Warning when spark.storage.memoryFraction is not between 0 and 1

[ https://issues.apache.org/jira/browse/SPARK-1779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996567#comment-13996567 ] Erik Erlandson commented on SPARK-1779: --- I'd like to propose an additional (somewhat

[jira] [Closed] (SPARK-1821) Document History Server

[ https://issues.apache.org/jira/browse/SPARK-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu closed SPARK-1821. -- Resolution: Implemented sorry, missed some documents > Document History Server > --- > >

[jira] [Created] (SPARK-1810) The spark tar ball does not unzip into a separate folder when un-tarred.

Manikandan Narayanaswamy created SPARK-1810: --- Summary: The spark tar ball does not unzip into a separate folder when un-tarred. Key: SPARK-1810 URL: https://issues.apache.org/jira/browse/SPARK-1810

[jira] [Created] (SPARK-1808) bin/pyspark does not load default configuration properties

Andrew Or created SPARK-1808: Summary: bin/pyspark does not load default configuration properties Key: SPARK-1808 URL: https://issues.apache.org/jira/browse/SPARK-1808 Project: Spark Issue Type:

[jira] [Commented] (SPARK-1813) Add a utility to SparkConf that makes using Kryo really easy

[ https://issues.apache.org/jira/browse/SPARK-1813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996390#comment-13996390 ] Mridul Muralidharan commented on SPARK-1813: Writing a KryoRegistrator is the

[jira] [Created] (SPARK-1813) Add a utility to SparkConf that makes using Kryo really easy

Sandy Ryza created SPARK-1813: - Summary: Add a utility to SparkConf that makes using Kryo really easy Key: SPARK-1813 URL: https://issues.apache.org/jira/browse/SPARK-1813 Project: Spark Issue T

[jira] [Created] (SPARK-1809) Mesos backend doesn't respect HADOOP_CONF_DIR

Andrew Ash created SPARK-1809: - Summary: Mesos backend doesn't respect HADOOP_CONF_DIR Key: SPARK-1809 URL: https://issues.apache.org/jira/browse/SPARK-1809 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-1680) Clean up use of setExecutorEnvs in SparkConf

[ https://issues.apache.org/jira/browse/SPARK-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1680: --- Fix Version/s: (was: 1.0.0) 1.1.0 > Clean up use of setExecutorEnvs in

[jira] [Commented] (SPARK-1819) Fix GetField.nullable.

[ https://issues.apache.org/jira/browse/SPARK-1819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996201#comment-13996201 ] Takuya Ueshin commented on SPARK-1819: -- Pull-requested: https://github.com/apache/spa

[jira] [Comment Edited] (SPARK-1802) Audit dependency graph when Spark is built with -Phive

[ https://issues.apache.org/jira/browse/SPARK-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13995815#comment-13995815 ] Sean Owen edited comment on SPARK-1802 at 5/13/14 11:27 AM: (E

[jira] [Commented] (SPARK-1760) mvn -Dsuites=* test throw an ClassNotFoundException

[ https://issues.apache.org/jira/browse/SPARK-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13993493#comment-13993493 ] Sean Owen commented on SPARK-1760: -- If `wildcardSuites` lets you invoke specific suites a

[jira] [Resolved] (SPARK-1802) Audit dependency graph when Spark is built with -Phive

[ https://issues.apache.org/jira/browse/SPARK-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1802. Resolution: Fixed Issue resolved by pull request 744 [https://github.com/apache/spark/pull/

[jira] [Created] (SPARK-1820) Make GenerateMimaIgnore @DeveloperApi annotation aware.

Prashant Sharma created SPARK-1820: -- Summary: Make GenerateMimaIgnore @DeveloperApi annotation aware. Key: SPARK-1820 URL: https://issues.apache.org/jira/browse/SPARK-1820 Project: Spark Iss

[jira] [Created] (SPARK-1819) Fix GetField.nullable.

Takuya Ueshin created SPARK-1819: Summary: Fix GetField.nullable. Key: SPARK-1819 URL: https://issues.apache.org/jira/browse/SPARK-1819 Project: Spark Issue Type: Bug Components: SQ

[jira] [Comment Edited] (SPARK-1802) Audit dependency graph when Spark is built with -Phive

[ https://issues.apache.org/jira/browse/SPARK-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996178#comment-13996178 ] Patrick Wendell edited comment on SPARK-1802 at 5/13/14 8:18 AM: ---

[jira] [Commented] (SPARK-1802) Audit dependency graph when Spark is built with -Phive

[ https://issues.apache.org/jira/browse/SPARK-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996178#comment-13996178 ] Patrick Wendell commented on SPARK-1802: This protobuf thing is very troubling. Th

[jira] [Resolved] (SPARK-1780) Non-existent SPARK_DAEMON_OPTS is referred to in a few places

[ https://issues.apache.org/jira/browse/SPARK-1780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1780. Resolution: Fixed Assignee: Andrew Or (was: Patrick Wendell) > Non-existent SPARK_DA

[jira] [Commented] (SPARK-1818) Freshen Mesos docs

[ https://issues.apache.org/jira/browse/SPARK-1818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996146#comment-13996146 ] Andrew Ash commented on SPARK-1818: --- https://github.com/apache/spark/pull/756 > Freshen

[jira] [Commented] (SPARK-1616) input file not found issue

[ https://issues.apache.org/jira/browse/SPARK-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13994044#comment-13994044 ] Marcelo Vanzin commented on SPARK-1616: --- Hi Prasad, This doesn't really sound like

[jira] [Commented] (SPARK-1649) Figure out Nullability semantics for Array elements and Map values

[ https://issues.apache.org/jira/browse/SPARK-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13994194#comment-13994194 ] Andre Schumacher commented on SPARK-1649: - Sorry for the delay. OK, not allowing n

[jira] [Created] (SPARK-1817) RDD zip erroneous when partitions do not divide RDD count

Michael Malak created SPARK-1817: Summary: RDD zip erroneous when partitions do not divide RDD count Key: SPARK-1817 URL: https://issues.apache.org/jira/browse/SPARK-1817 Project: Spark Issue