[jira] [Commented] (SPARK-1925) Typo in org.apache.spark.mllib.tree.DecisionTree.isSampleValid

2014-05-25 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14008584#comment-14008584 ] Shixiong Zhu commented on SPARK-1925: - PR: https://github.com/apache/spark/pull/879 >

[jira] [Updated] (SPARK-1925) Typo in org.apache.spark.mllib.tree.DecisionTree.isSampleValid

2014-05-25 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-1925: Description: I believe this is a typo: if ((level > 0) & (parentFilters.length == 0)) {

[jira] [Created] (SPARK-1925) Typo in org.apache.spark.mllib.tree.DecisionTree.isSampleValid

2014-05-25 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-1925: --- Summary: Typo in org.apache.spark.mllib.tree.DecisionTree.isSampleValid Key: SPARK-1925 URL: https://issues.apache.org/jira/browse/SPARK-1925 Project: Spark I

[jira] [Commented] (SPARK-983) Support external sorting for RDD#sortByKey()

2014-05-25 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14008557#comment-14008557 ] Aaron Davidson commented on SPARK-983: -- [~pwendell] or [~matei], any opinions on memor

[jira] [Commented] (SPARK-983) Support external sorting for RDD#sortByKey()

2014-05-25 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14008554#comment-14008554 ] Aaron Davidson commented on SPARK-983: -- Historically, we have not used Runtime.freeMem

[jira] [Assigned] (SPARK-1566) Consolidate the Spark Programming Guide with tabs for all languages

2014-05-25 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia reassigned SPARK-1566: Assignee: Matei Zaharia > Consolidate the Spark Programming Guide with tabs for all languag

[jira] [Assigned] (SPARK-1843) Provide a simpler alternative to assemble-deps

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-1843: -- Assignee: Patrick Wendell (was: Prashant Sharma) > Provide a simpler alternative to as

[jira] [Commented] (SPARK-983) Support external sorting for RDD#sortByKey()

2014-05-25 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14008440#comment-14008440 ] Andrew Ash commented on SPARK-983: -- Because ExternalAppendOnlyMap uses Runtime.getRuntime.

[jira] [Created] (SPARK-1924) Make local:/ scheme work in more deploy modes

2014-05-25 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-1924: Summary: Make local:/ scheme work in more deploy modes Key: SPARK-1924 URL: https://issues.apache.org/jira/browse/SPARK-1924 Project: Spark Issue Type: Sub-t

[jira] [Resolved] (SPARK-1894) The default ec2 set-up ignores --driver-class-path

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1894. Resolution: Fixed Fix Version/s: (was: 1.0.1) 1.0.0 A

[jira] [Updated] (SPARK-1894) The default ec2 set-up ignores --driver-class-path

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1894: --- Component/s: EC2 > The default ec2 set-up ignores --driver-class-path > -

[jira] [Updated] (SPARK-1894) The default ec2 set-up ignores --driver-class-path

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1894: --- Issue Type: Task (was: Bug) > The default ec2 set-up ignores --driver-class-path > -

[jira] [Resolved] (SPARK-1857) map() with lookup() causes exception

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1857. Resolution: Not a Problem I'm closing this but report for now since it's a known property o

[jira] [Assigned] (SPARK-1887) Update "Contributors Guide" with useful data from past threads

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-1887: -- Assignee: Patrick Wendell > Update "Contributors Guide" with useful data from past thre

[jira] [Updated] (SPARK-1887) Update "Contributors Guide" with useful data from past threads

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1887: --- Assignee: Sujeet Varakhedi > Update "Contributors Guide" with useful data from past threads >

[jira] [Updated] (SPARK-1887) Update "Contributors Guide" with useful data from past threads

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1887: --- Assignee: (was: Patrick Wendell) > Update "Contributors Guide" with useful data from past

[jira] [Updated] (SPARK-1250) Misleading comments in Spark startup scripts

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1250: --- Assignee: Sumedh Mungee > Misleading comments in Spark startup scripts >

[jira] [Resolved] (SPARK-1250) Misleading comments in Spark startup scripts

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1250. Resolution: Fixed Fix Version/s: 1.0.0 > Misleading comments in Spark startup script

[jira] [Resolved] (SPARK-1918) PySpark shell --py-files does not work for zip files

2014-05-25 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1918. -- Resolution: Fixed > PySpark shell --py-files does not work for zip files >

[jira] [Updated] (SPARK-1923) ClassNotFoundException when running with sbt and Scala 2.10.3

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1923: --- Description: I just wanted to document this for posterity. I had an issue when running a Spa

[jira] [Resolved] (SPARK-1410) Class not found exception with application launched from sbt 0.13.x

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1410. Resolution: Fixed Assignee: Xiangrui Meng Solution is to upgrade to Scala 2.10.4. >

[jira] [Commented] (SPARK-1410) Class not found exception with application launched from sbt 0.13.x

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14008424#comment-14008424 ] Patrick Wendell commented on SPARK-1410: I ran into a similar issue SPARK-1923. It

[jira] [Resolved] (SPARK-1923) ClassNotFoundException when running with sbt and Scala 2.10.3

2014-05-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1923. Resolution: Fixed > ClassNotFoundException when running with sbt and Scala 2.10.3 > ---

[jira] [Created] (SPARK-1923) ClassNotFoundException when running with sbt and Scala 2.10.3

2014-05-25 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1923: -- Summary: ClassNotFoundException when running with sbt and Scala 2.10.3 Key: SPARK-1923 URL: https://issues.apache.org/jira/browse/SPARK-1923 Project: Spark

[jira] [Commented] (SPARK-1473) Feature selection for high dimensional datasets

2014-05-25 Thread sam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14008334#comment-14008334 ] sam commented on SPARK-1473: +1 Info Gain / KL / Mutual Information, and all that, certainly a

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

2014-05-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14008329#comment-14008329 ] Sean Owen commented on SPARK-1867: -- Well, for example, MapReduce classes are from one of

[jira] [Updated] (SPARK-1922) hql query throws "RuntimeException: Unsupported dataType" if struct field of a table has a column with underscore in name

2014-05-25 Thread llai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] llai updated SPARK-1922: Summary: hql query throws "RuntimeException: Unsupported dataType" if struct field of a table has a column with und

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

2014-05-25 Thread sam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14008326#comment-14008326 ] sam commented on SPARK-1867: [~srowen] Thanks for you response, I believe I understand the sit

[jira] [Commented] (SPARK-1922) hql query throws "RuntimeException: Unsupported dataType" if table has a struct field which has a column with underscore in its name

2014-05-25 Thread llai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14008325#comment-14008325 ] llai commented on SPARK-1922: - My table uses avro serde. Checked Hive [LanguageManual DDL|htt

[jira] [Created] (SPARK-1922) hql query throws "RuntimeException: Unsupported dataType" if table has a struct field which has a column with underscore in its name

2014-05-25 Thread llai (JIRA)
llai created SPARK-1922: --- Summary: hql query throws "RuntimeException: Unsupported dataType" if table has a struct field which has a column with underscore in its name Key: SPARK-1922 URL: https://issues.apache.org/jira/bro

[jira] [Resolved] (SPARK-1822) SchemaRDD.count() should use the optimizer.

2014-05-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-1822. Resolution: Fixed > SchemaRDD.count() should use the optimizer. > -