[jira] [Created] (SPARK-8564) Add the Python API for Kinesis

2015-06-23 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-8564: --- Summary: Add the Python API for Kinesis Key: SPARK-8564 URL: https://issues.apache.org/jira/browse/SPARK-8564 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-8564) Add the Python API for Kinesis

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8564: --- Assignee: Apache Spark Add the Python API for Kinesis --

[jira] [Commented] (SPARK-8525) Bug in Streaming k-means documentation

2015-06-23 Thread Oleksiy Dyagilev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597798#comment-14597798 ] Oleksiy Dyagilev commented on SPARK-8525: - Makes sense,

[jira] [Assigned] (SPARK-8564) Add the Python API for Kinesis

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8564: --- Assignee: (was: Apache Spark) Add the Python API for Kinesis

[jira] [Commented] (SPARK-8564) Add the Python API for Kinesis

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597814#comment-14597814 ] Apache Spark commented on SPARK-8564: - User 'zsxwing' has created a pull request for

[jira] [Resolved] (SPARK-5964) Allow spark-daemon.sh to support foreground operation

2015-06-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5964. -- Resolution: Won't Fix Allow spark-daemon.sh to support foreground operation

[jira] [Assigned] (SPARK-8562) Annoying messages about executor lost after stopping SparkContext

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8562: --- Assignee: Apache Spark Annoying messages about executor lost after stopping SparkContext

[jira] [Assigned] (SPARK-8562) Annoying messages about executor lost after stopping SparkContext

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8562: --- Assignee: (was: Apache Spark) Annoying messages about executor lost after stopping

[jira] [Assigned] (SPARK-8525) Bug in Streaming k-means documentation

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8525: --- Assignee: (was: Apache Spark) Bug in Streaming k-means documentation

[jira] [Commented] (SPARK-8525) Bug in Streaming k-means documentation

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597789#comment-14597789 ] Apache Spark commented on SPARK-8525: - User 'fe2s' has created a pull request for this

[jira] [Assigned] (SPARK-8525) Bug in Streaming k-means documentation

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8525: --- Assignee: Apache Spark Bug in Streaming k-means documentation

[jira] [Commented] (SPARK-8563) Bug that IndexedRowMatrix.computeSVD() yields the U with wrong numCols

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597641#comment-14597641 ] Apache Spark commented on SPARK-8563: - User 'lee19' has created a pull request for

[jira] [Commented] (SPARK-8562) Annoying messages about executor lost after stopping SparkContext

2015-06-23 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597581#comment-14597581 ] Jacek Lewandowski commented on SPARK-8562: -- [~vanzin] could you please take a

[jira] [Commented] (SPARK-8562) Annoying messages about executor lost after stopping SparkContext

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597579#comment-14597579 ] Apache Spark commented on SPARK-8562: - User 'jacek-lewandowski' has created a pull

[jira] [Updated] (SPARK-8563) Bug that IndexedRowMatrix.computeSVD() yields the U with wrong numCols

2015-06-23 Thread 19 Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 19 Lee updated SPARK-8563: -- Description: IndexedRowMatrix.computeSVD() yields a wrong U which *U.numCols() = self.nCols*. It should have

[jira] [Commented] (SPARK-8565) TF-IDF drops records

2015-06-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597872#comment-14597872 ] Sean Owen commented on SPARK-8565: -- You'll need to provide an example. Guess: do you have

[jira] [Commented] (SPARK-8558) Script /dev/run-tests fails when _JAVA_OPTIONS env var set

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597919#comment-14597919 ] Apache Spark commented on SPARK-8558: - User 'fe2s' has created a pull request for this

[jira] [Created] (SPARK-8566) lateral view query blows up unless pushed down to a subquery

2015-06-23 Thread Eric Friedman (JIRA)
Eric Friedman created SPARK-8566: Summary: lateral view query blows up unless pushed down to a subquery Key: SPARK-8566 URL: https://issues.apache.org/jira/browse/SPARK-8566 Project: Spark

[jira] [Commented] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

2015-06-23 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597956#comment-14597956 ] Matt Cheah commented on SPARK-8167: --- I'm starting to work on this now, sorry for the

[jira] [Updated] (SPARK-8445) MLlib 1.5 Roadmap

2015-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8445: - Description: We expect to see many MLlib contributors for the 1.5 release. To scale out the

[jira] [Commented] (SPARK-8525) Bug in Streaming k-means documentation

2015-06-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597861#comment-14597861 ] Sean Owen commented on SPARK-8525: -- (Nit: this isn't really a bug in the docs right? and

[jira] [Commented] (SPARK-6126) Support UDTs in JSON

2015-06-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597860#comment-14597860 ] Yin Huai commented on SPARK-6126: - Per discussion in

[jira] [Created] (SPARK-8567) HiveSparkSubmitSuite is flaky

2015-06-23 Thread Yin Huai (JIRA)
Yin Huai created SPARK-8567: --- Summary: HiveSparkSubmitSuite is flaky Key: SPARK-8567 URL: https://issues.apache.org/jira/browse/SPARK-8567 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-8556) Beeline script throws ClassNotFoundException

2015-06-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-8556. --- Resolution: Not A Problem False alarm, environmental issue on my test machine. Beeline script

[jira] [Updated] (SPARK-8445) MLlib 1.5 Roadmap

2015-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8445: - Description: We expect to see many MLlib contributors for the 1.5 release. To scale out the

[jira] [Created] (SPARK-8565) TF-IDF drops records

2015-06-23 Thread PJ Van Aeken (JIRA)
PJ Van Aeken created SPARK-8565: --- Summary: TF-IDF drops records Key: SPARK-8565 URL: https://issues.apache.org/jira/browse/SPARK-8565 Project: Spark Issue Type: Bug Components: MLlib

[jira] [Updated] (SPARK-8498) Fix NullPointerException in error-handling path in UnsafeShuffleWriter

2015-06-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8498: -- Target Version/s: 1.4.2 (was: 1.4.1) Fix NullPointerException in error-handling path in

[jira] [Reopened] (SPARK-8498) Fix NullPointerException in error-handling path in UnsafeShuffleWriter

2015-06-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-8498: --- Re-opening because I had to revert the branch-1.4 patch due to a Java 6 compilation issue. Fix

[jira] [Updated] (SPARK-8498) Fix NullPointerException in error-handling path in UnsafeShuffleWriter

2015-06-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8498: -- Fix Version/s: (was: 1.4.2) Fix NullPointerException in error-handling path in UnsafeShuffleWriter

[jira] [Updated] (SPARK-8279) udf_round_3 test fails

2015-06-23 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8279: Shepherd: Reynold Xin udf_round_3 test fails --

[jira] [Commented] (SPARK-8565) TF-IDF drops records

2015-06-23 Thread PJ Van Aeken (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597900#comment-14597900 ] PJ Van Aeken commented on SPARK-8565: - No but the data comes from ElasticSearch

[jira] [Resolved] (SPARK-7235) Refactor the GroupingSet implementation

2015-06-23 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7235. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 5780

[jira] [Resolved] (SPARK-8498) Fix NullPointerException in error-handling path in UnsafeShuffleWriter

2015-06-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8498. --- Resolution: Fixed Fix Version/s: 1.4.2 1.5.0 Issue resolved by pull request

[jira] [Assigned] (SPARK-8558) Script /dev/run-tests fails when _JAVA_OPTIONS env var set

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8558: --- Assignee: (was: Apache Spark) Script /dev/run-tests fails when _JAVA_OPTIONS env var

[jira] [Commented] (SPARK-4038) Outlier Detection Algorithm for MLlib

2015-06-23 Thread Ashutosh Trivedi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597967#comment-14597967 ] Ashutosh Trivedi commented on SPARK-4038: - AVF is suited for categorical data. Can

[jira] [Updated] (SPARK-8445) MLlib 1.5 Roadmap

2015-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8445: - Description: We expect to see many MLlib contributors for the 1.5 release. To scale out the

[jira] [Commented] (SPARK-746) Automatically Use Avro Serialization for Avro Objects

2015-06-23 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597973#comment-14597973 ] Joseph Batchik commented on SPARK-746: -- Spark can currently serialize the three type

[jira] [Updated] (SPARK-8445) MLlib 1.5 Roadmap

2015-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8445: - Description: (was: TBA) MLlib 1.5 Roadmap - Key:

[jira] [Commented] (SPARK-8156) Respect current database when creating datasource tables

2015-06-23 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598153#comment-14598153 ] Michael Armbrust commented on SPARK-8156: - We typically won't backport things that

[jira] [Commented] (SPARK-8565) TF-IDF drops records

2015-06-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598154#comment-14598154 ] Sean Owen commented on SPARK-8565: -- Well, it means that every time you go to evaluate

[jira] [Created] (SPARK-8570) Improve MLlib Local Matrix Documentation.

2015-06-23 Thread Mike Dusenberry (JIRA)
Mike Dusenberry created SPARK-8570: -- Summary: Improve MLlib Local Matrix Documentation. Key: SPARK-8570 URL: https://issues.apache.org/jira/browse/SPARK-8570 Project: Spark Issue Type:

[jira] [Updated] (SPARK-8445) MLlib 1.5 Roadmap

2015-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8445: - Description: We expect to see many MLlib contributors for the 1.5 release. To scale out the

[jira] [Updated] (SPARK-8445) MLlib 1.5 Roadmap

2015-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8445: - Description: We expect to see many MLlib contributors for the 1.5 release. To scale out the

[jira] [Updated] (SPARK-8445) MLlib 1.5 Roadmap

2015-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8445: - Description: We expect to see many MLlib contributors for the 1.5 release. To scale out the

[jira] [Updated] (SPARK-8445) MLlib 1.5 Roadmap

2015-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8445: - Description: We expect to see many MLlib contributors for the 1.5 release. To scale out the

[jira] [Commented] (SPARK-8566) lateral view query blows up unless pushed down to a subquery

2015-06-23 Thread Eric Friedman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598159#comment-14598159 ] Eric Friedman commented on SPARK-8566: -- Unfortunately I cannot disclose the exact

[jira] [Assigned] (SPARK-8570) Improve MLlib Local Matrix Documentation.

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8570: --- Assignee: (was: Apache Spark) Improve MLlib Local Matrix Documentation.

[jira] [Commented] (SPARK-8570) Improve MLlib Local Matrix Documentation.

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598165#comment-14598165 ] Apache Spark commented on SPARK-8570: - User 'dusenberrymw' has created a pull request

[jira] [Assigned] (SPARK-8570) Improve MLlib Local Matrix Documentation.

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8570: --- Assignee: Apache Spark Improve MLlib Local Matrix Documentation.

[jira] [Commented] (SPARK-8566) lateral view query blows up unless pushed down to a subquery

2015-06-23 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598136#comment-14598136 ] Michael Armbrust commented on SPARK-8566: - What is the schema of your file? That

[jira] [Updated] (SPARK-8571) spark streaming hanging processes upon build exit

2015-06-23 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp updated SPARK-8571: --- Description: over the past 3 months i've been noticing that there are occasionally hanging processes

[jira] [Resolved] (SPARK-8432) Fix hashCode and equals() of BinaryType in Row

2015-06-23 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8432. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6876

[jira] [Updated] (SPARK-8445) MLlib 1.5 Roadmap

2015-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8445: - Description: We expect to see many MLlib contributors for the 1.5 release. To scale out the

[jira] [Commented] (SPARK-8567) HiveSparkSubmitSuite is flaky

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598133#comment-14598133 ] Apache Spark commented on SPARK-8567: - User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-8567) HiveSparkSubmitSuite is flaky

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8567: --- Assignee: Yin Huai (was: Apache Spark) HiveSparkSubmitSuite is flaky

[jira] [Created] (SPARK-8568) Prevent accidental use of and and or to build invalid expressions in Python

2015-06-23 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8568: -- Summary: Prevent accidental use of and and or to build invalid expressions in Python Key: SPARK-8568 URL: https://issues.apache.org/jira/browse/SPARK-8568 Project: Spark

[jira] [Updated] (SPARK-8552) Using incorrect database in multiple sessions

2015-06-23 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8552: Issue Type: Sub-task (was: Bug) Parent: SPARK-8131 Using incorrect database in

[jira] [Assigned] (SPARK-8567) HiveSparkSubmitSuite is flaky

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8567: --- Assignee: Apache Spark (was: Yin Huai) HiveSparkSubmitSuite is flaky

[jira] [Created] (SPARK-8569) Documentation for SPARK_HISTORY_OPTS unclear

2015-06-23 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-8569: Summary: Documentation for SPARK_HISTORY_OPTS unclear Key: SPARK-8569 URL: https://issues.apache.org/jira/browse/SPARK-8569 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-8571) spark streaming hanging processes upon build exit

2015-06-23 Thread shane knapp (JIRA)
shane knapp created SPARK-8571: -- Summary: spark streaming hanging processes upon build exit Key: SPARK-8571 URL: https://issues.apache.org/jira/browse/SPARK-8571 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-8573) For PySpark's DataFrame API, we need to throw exceptions when users try to use and/or/not

2015-06-23 Thread Yin Huai (JIRA)
Yin Huai created SPARK-8573: --- Summary: For PySpark's DataFrame API, we need to throw exceptions when users try to use and/or/not Key: SPARK-8573 URL: https://issues.apache.org/jira/browse/SPARK-8573

[jira] [Updated] (SPARK-8525) Bug in Streaming k-means documentation

2015-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8525: - Fix Version/s: 1.4.2 1.3.2 1.2.3 1.1.2

[jira] [Updated] (SPARK-8525) Bug in Streaming k-means documentation

2015-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8525: - Affects Version/s: (was: 1.4.0) 1.4.1 1.1.1

[jira] [Commented] (SPARK-8575) Deprecate callUDF in favor of udf

2015-06-23 Thread Benjamin Fradet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598353#comment-14598353 ] Benjamin Fradet commented on SPARK-8575: I've started working on this issue.

[jira] [Commented] (SPARK-8568) Prevent accidental use of and and or to build invalid expressions in Python

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598369#comment-14598369 ] Apache Spark commented on SPARK-8568: - User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-8573) For PySpark's DataFrame API, we need to throw exceptions when users try to use and/or/not

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8573: --- Assignee: Apache Spark (was: Davies Liu) For PySpark's DataFrame API, we need to throw

[jira] [Assigned] (SPARK-8568) Prevent accidental use of and and or to build invalid expressions in Python

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8568: --- Assignee: Davies Liu (was: Apache Spark) Prevent accidental use of and and or to build

[jira] [Resolved] (SPARK-8525) Bug in Streaming k-means documentation

2015-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8525. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6954

[jira] [Created] (SPARK-8574) org/apache/spark/unsafe doesn't honor the java source/target versions

2015-06-23 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-8574: Summary: org/apache/spark/unsafe doesn't honor the java source/target versions Key: SPARK-8574 URL: https://issues.apache.org/jira/browse/SPARK-8574 Project: Spark

[jira] [Commented] (SPARK-8573) For PySpark's DataFrame API, we need to throw exceptions when users try to use and/or/not

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598368#comment-14598368 ] Apache Spark commented on SPARK-8573: - User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-8568) Prevent accidental use of and and or to build invalid expressions in Python

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8568: --- Assignee: Apache Spark (was: Davies Liu) Prevent accidental use of and and or to build

[jira] [Assigned] (SPARK-8573) For PySpark's DataFrame API, we need to throw exceptions when users try to use and/or/not

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8573: --- Assignee: Davies Liu (was: Apache Spark) For PySpark's DataFrame API, we need to throw

[jira] [Resolved] (SPARK-6220) Allow extended EC2 options to be passed through spark-ec2

2015-06-23 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-6220. - Resolution: Won't Fix Resolving this issue as won't fix since it is of low importance and

[jira] [Updated] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

2015-06-23 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8167: - Assignee: Matt Cheah (was: Matthew Cheah) Tasks that fail due to YARN preemption can cause job failure

[jira] [Commented] (SPARK-8576) Add spark-ec2 options to assign launched instances into IAM roles and to set instance-initiated shutdown behavior

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598432#comment-14598432 ] Apache Spark commented on SPARK-8576: - User 'nchammas' has created a pull request for

[jira] [Assigned] (SPARK-8576) Add spark-ec2 options to assign launched instances into IAM roles and to set instance-initiated shutdown behavior

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8576: --- Assignee: Apache Spark Add spark-ec2 options to assign launched instances into IAM roles

[jira] [Commented] (SPARK-8456) Python API for N-Gram Feature Transformer

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598363#comment-14598363 ] Apache Spark commented on SPARK-8456: - User 'feynmanliang' has created a pull request

[jira] [Assigned] (SPARK-8456) Python API for N-Gram Feature Transformer

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8456: --- Assignee: (was: Apache Spark) Python API for N-Gram Feature Transformer

[jira] [Updated] (SPARK-8560) The Executors page will have negative if having resubmitted tasks

2015-06-23 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8560: - Component/s: Web UI The Executors page will have negative if having resubmitted tasks

[jira] [Updated] (SPARK-8576) Add spark-ec2 options to assign launched instances into IAM roles and to set instance-initiated shutdown behavior

2015-06-23 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-8576: Summary: Add spark-ec2 options to assign launched instances into IAM roles and to set

[jira] [Updated] (SPARK-8525) Bug in Streaming k-means documentation

2015-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8525: - Assignee: Oleksiy Dyagilev Bug in Streaming k-means documentation

[jira] [Closed] (SPARK-7888) Be able to disable intercept in Linear Regression in ML package

2015-06-23 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai closed SPARK-7888. -- Resolution: Done Fix Version/s: 1.5.0 Target Version/s: 1.5.0 Be able to disable intercept in

[jira] [Updated] (SPARK-8575) Deprecate callUDF in favor of udf

2015-06-23 Thread Benjamin Fradet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Fradet updated SPARK-8575: --- Description: Follow-up of [SPARK-8356|https://issues.apache.org/jira/browse/SPARK-8356] to

[jira] [Updated] (SPARK-8560) The Executors page will have negative if having resubmitted tasks

2015-06-23 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8560: - Affects Version/s: 1.0.0 The Executors page will have negative if having resubmitted tasks

[jira] [Created] (SPARK-8576) Add spark-ec2 options to assigned launched instances into IAM roles and to set instance-initiated shutdown behavior

2015-06-23 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-8576: --- Summary: Add spark-ec2 options to assigned launched instances into IAM roles and to set instance-initiated shutdown behavior Key: SPARK-8576 URL:

[jira] [Updated] (SPARK-8560) The Executors page will have negative if having resubmitted tasks

2015-06-23 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8560: - Target Version/s: 1.4.1, 1.5.0 The Executors page will have negative if having resubmitted tasks

[jira] [Updated] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

2015-06-23 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8167: - Assignee: Matthew Cheah Tasks that fail due to YARN preemption can cause job failure

[jira] [Created] (SPARK-8572) Type coercion for ScalaUDFs

2015-06-23 Thread Yin Huai (JIRA)
Yin Huai created SPARK-8572: --- Summary: Type coercion for ScalaUDFs Key: SPARK-8572 URL: https://issues.apache.org/jira/browse/SPARK-8572 Project: Spark Issue Type: Bug Components: SQL

[jira] [Commented] (SPARK-7888) Be able to disable intercept in Linear Regression in ML package

2015-06-23 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598282#comment-14598282 ] DB Tsai commented on SPARK-7888: merged into master.

[jira] [Updated] (SPARK-8546) PMML export for Naive Bayes

2015-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8546: - Target Version/s: 1.5.0 PMML export for Naive Bayes ---

[jira] [Resolved] (SPARK-8573) For PySpark's DataFrame API, we need to throw exceptions when users try to use and/or/not

2015-06-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-8573. - Resolution: Duplicate For PySpark's DataFrame API, we need to throw exceptions when users try to use

[jira] [Updated] (SPARK-8567) HiveSparkSubmitSuite is flaky

2015-06-23 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8567: - Labels: flaky-test (was: ) HiveSparkSubmitSuite is flaky -

[jira] [Updated] (SPARK-8567) HiveSparkSubmitSuite is flaky

2015-06-23 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8567: - Priority: Critical (was: Major) HiveSparkSubmitSuite is flaky -

[jira] [Updated] (SPARK-8573) For PySpark's DataFrame API, we need to throw exceptions when users try to use and/or/not

2015-06-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8573: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-6116 For PySpark's DataFrame API, we need to

[jira] [Updated] (SPARK-8567) Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars

2015-06-23 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8567: - Summary: Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars (was: HiveSparkSubmitSuite is flaky)

[jira] [Commented] (SPARK-8072) Better AnalysisException for writing DataFrame with identically named columns

2015-06-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598444#comment-14598444 ] Reynold Xin commented on SPARK-8072: [~animeshbaranawal] I think we should only apply

[jira] [Updated] (SPARK-8445) MLlib 1.5 Roadmap

2015-06-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8445: - Description: We expect to see many MLlib contributors for the 1.5 release. To scale out the

[jira] [Created] (SPARK-8577) ScalaReflectionLock.synchronized can cause deadlock

2015-06-23 Thread koert kuipers (JIRA)
koert kuipers created SPARK-8577: Summary: ScalaReflectionLock.synchronized can cause deadlock Key: SPARK-8577 URL: https://issues.apache.org/jira/browse/SPARK-8577 Project: Spark Issue

[jira] [Updated] (SPARK-8563) Bug that IndexedRowMatrix.computeSVD() yields the U with wrong numCols

2015-06-23 Thread 19 Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 19 Lee updated SPARK-8563: -- Description: IndexedRowMatrix.computeSVD() yields a wrong U which *U.numCols() = self.nCols*. It should have

[jira] [Assigned] (SPARK-8578) Should ignore user defined output committer when appending data

2015-06-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8578: --- Assignee: Apache Spark (was: Yin Huai) Should ignore user defined output committer when

  1   2   3   >