[jira] [Commented] (SPARK-1978) In some cases, spark-yarn does not automatically restart the failed container

2014-05-31 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14014563#comment-14014563 ] Guoqiang Li commented on SPARK-1978: The PR: https://github.com/apache/spark/pull/921

[jira] [Created] (SPARK-1979) Spark documentation needs to be updated to state that --arg is no longer required to run spark submit jobs

2014-05-31 Thread surbhi sharma (JIRA)
surbhi sharma created SPARK-1979: Summary: Spark documentation needs to be updated to state that --arg is no longer required to run spark submit jobs Key: SPARK-1979 URL:

[jira] [Updated] (SPARK-1979) Spark documentation needs to be updated to state that --arg is no longer required to run spark submit jobs

2014-05-31 Thread surbhi sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surbhi sharma updated SPARK-1979: - Description: https://github.com/apache/spark/commit/aa9a7f5db7bffcdbcd7fd53694c606d3a8cdd21f

[jira] [Updated] (SPARK-1979) Spark documentation needs to be updated to state that --arg is no longer required to run spark submit jobs

2014-05-31 Thread surbhi sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surbhi sharma updated SPARK-1979: - Description: https://github.com/apache/spark/commit/aa9a7f5db7bffcdbcd7fd53694c606d3a8cdd21f

[jira] [Updated] (SPARK-1979) Spark documentation needs to be updated to state that --arg is no longer required to run spark submit jobs

2014-05-31 Thread surbhi sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surbhi sharma updated SPARK-1979: - Description: https://github.com/apache/spark/commit/aa9a7f5db7bffcdbcd7fd53694c606d3a8cdd21f

[jira] [Updated] (SPARK-1979) Spark documentation needs to be updated to state that --arg is no longer required to run spark submit jobs

2014-05-31 Thread surbhi sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surbhi sharma updated SPARK-1979: - Description: https://github.com/apache/spark/commit/aa9a7f5db7bffcdbcd7fd53694c606d3a8cdd21f

[jira] [Updated] (SPARK-1979) Spark documentation needs to be updated and error message needs to be updated when user speifies--arg ( which is no longer required to run spark submit jobs)

2014-05-31 Thread surbhi sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surbhi sharma updated SPARK-1979: - Component/s: Spark Core Input/Output Description:

[jira] [Commented] (SPARK-1979) Error message needs to be updated when user specifies --arg ( which is no longer required to run spark submit jobs).Spark documentation needs to be updated to reflect t

2014-05-31 Thread surbhi sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14014623#comment-14014623 ] surbhi sharma commented on SPARK-1979: -- I added a pull request for this :

[jira] [Commented] (SPARK-1979) Error message needs to be updated when user specifies --arg ( which is no longer required to run spark submit jobs).Spark documentation needs to be updated to reflect t

2014-05-31 Thread pankaj arora (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14014624#comment-14014624 ] pankaj arora commented on SPARK-1979: - https://github.com/apache/spark/pull/930

[jira] [Created] (SPARK-1980) problems introduced by broadcast

2014-05-31 Thread zhoudi (JIRA)
zhoudi created SPARK-1980: - Summary: problems introduced by broadcast Key: SPARK-1980 URL: https://issues.apache.org/jira/browse/SPARK-1980 Project: Spark Issue Type: Bug Reporter:

[jira] [Updated] (SPARK-1980) problems introduced by broadcast

2014-05-31 Thread zhoudi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoudi updated SPARK-1980: -- Description: i am writing a word embedding on SPARK. The scale of the model is about 60w * 100 * Float.size.

[jira] [Updated] (SPARK-1980) problems introduced by broadcast

2014-05-31 Thread zhoudi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoudi updated SPARK-1980: -- Description: i am writing a word embedding on SPARK. The scale of the model is about 60w * 100 * Float.size.

[jira] [Updated] (SPARK-1980) problems introduced by broadcast

2014-05-31 Thread zhoudi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoudi updated SPARK-1980: -- Description: i am writing a word embedding on SPARK. The scale of the model is about 60w * 100 * Float.size.

[jira] [Commented] (SPARK-1954) Make it easier to get Spark on YARN code to compile in IntelliJ

2014-05-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14014711#comment-14014711 ] Patrick Wendell commented on SPARK-1954: Yeah, why not just set `hadoop.version`

[jira] [Resolved] (SPARK-1947) Child of SumDistinct or Average should be widened to prevent overflows the same as Sum.

2014-05-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1947. - Resolution: Fixed Child of SumDistinct or Average should be widened to prevent

[jira] [Updated] (SPARK-1947) Child of SumDistinct or Average should be widened to prevent overflows the same as Sum.

2014-05-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-1947: Fix Version/s: 1.1.0 1.0.1 Child of SumDistinct or Average should be

[jira] [Resolved] (SPARK-1839) PySpark take() does not launch a Spark job when it has to

2014-05-31 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-1839. Resolution: Fixed Assignee: Aaron Davidson PySpark take() does not launch a Spark job when

[jira] [Created] (SPARK-1981) Add AWS Kinesis streaming support

2014-05-31 Thread Chris Fregly (JIRA)
Chris Fregly created SPARK-1981: --- Summary: Add AWS Kinesis streaming support Key: SPARK-1981 URL: https://issues.apache.org/jira/browse/SPARK-1981 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-1917) PySpark fails to import functions from {{scipy.special}}

2014-05-31 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-1917. -- Resolution: Fixed PySpark fails to import functions from {{scipy.special}}

[jira] [Updated] (SPARK-1917) PySpark fails to import functions from {{scipy.special}}

2014-05-31 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-1917: - Assignee: Uri Laserson PySpark fails to import functions from {{scipy.special}}

[jira] [Commented] (SPARK-1518) Spark master doesn't compile against hadoop-common trunk

2014-05-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14014910#comment-14014910 ] Colin Patrick McCabe commented on SPARK-1518: - It seems reasonable to have a