[jira] [Created] (SPARK-4111) Implement regression model evaluation metrics

2014-10-28 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-4111: -- Summary: Implement regression model evaluation metrics Key: SPARK-4111 URL: https://issues.apache.org/jira/browse/SPARK-4111 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-3975) Block Matrix addition and multiplication

2014-10-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3975: - Assignee: (was: Burak Yavuz) Block Matrix addition and multiplication

[jira] [Updated] (SPARK-3975) Block Matrix addition and multiplication

2014-10-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3975: - Assignee: Burak Yavuz Block Matrix addition and multiplication

[jira] [Updated] (SPARK-4060) MLlib, exposing special rdd functions to the public

2014-10-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4060: - Assignee: Niklas Wilcke MLlib, exposing special rdd functions to the public

[jira] [Updated] (SPARK-3509) Method for generating random LabeledPoints for testing

2014-10-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3509: - Target Version/s: (was: 1.2.0) Method for generating random LabeledPoints for testing

[jira] [Updated] (SPARK-3509) Method for generating random LabeledPoints for testing

2014-10-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3509: - Fix Version/s: (was: 1.2.0) Method for generating random LabeledPoints for testing

[jira] [Created] (SPARK-4112) Have a reserved copy of Sorter/SortDataFormat

2014-10-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-4112: Summary: Have a reserved copy of Sorter/SortDataFormat Key: SPARK-4112 URL: https://issues.apache.org/jira/browse/SPARK-4112 Project: Spark Issue Type:

[jira] [Created] (SPARK-4113) Pyhon UDF on ArrayType

2014-10-28 Thread Davies Liu (JIRA)
Davies Liu created SPARK-4113: - Summary: Pyhon UDF on ArrayType Key: SPARK-4113 URL: https://issues.apache.org/jira/browse/SPARK-4113 Project: Spark Issue Type: Bug Components:

[jira] [Resolved] (SPARK-4064) NioBlockTransferService should deal with empty messages correctly

2014-10-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-4064. Resolution: Fixed NioBlockTransferService should deal with empty messages correctly

[jira] [Created] (SPARK-4114) Use stable Hive API (if one exists) for communication with Metastore

2014-10-28 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-4114: -- Summary: Use stable Hive API (if one exists) for communication with Metastore Key: SPARK-4114 URL: https://issues.apache.org/jira/browse/SPARK-4114 Project:

[jira] [Updated] (SPARK-4111) [MLlib] Implement regression model evaluation metrics

2014-10-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-4111: --- Summary: [MLlib] Implement regression model evaluation metrics (was: Implement regression model

[jira] [Commented] (SPARK-4111) [MLlib] Implement regression model evaluation metrics

2014-10-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186496#comment-14186496 ] Sean Owen commented on SPARK-4111: -- Is this more than just MAE / RMSE / R2? It might be

[jira] [Created] (SPARK-4115) add overrided count for EdgeRDD

2014-10-28 Thread Lu Lu (JIRA)
Lu Lu created SPARK-4115: Summary: add overrided count for EdgeRDD Key: SPARK-4115 URL: https://issues.apache.org/jira/browse/SPARK-4115 Project: Spark Issue Type: Improvement Components:

[jira] [Updated] (SPARK-4115) [GraphX] add overrided count for EdgeRDD

2014-10-28 Thread Lu Lu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lu Lu updated SPARK-4115: - Summary: [GraphX] add overrided count for EdgeRDD (was: add overrided count for EdgeRDD) [GraphX] add

[jira] [Commented] (SPARK-4107) Incorrect handling of Channel.read()'s return value may lead to data truncation

2014-10-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186506#comment-14186506 ] Apache Spark commented on SPARK-4107: - User 'JoshRosen' has created a pull request for

[jira] [Commented] (SPARK-4111) [MLlib] Implement regression model evaluation metrics

2014-10-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186514#comment-14186514 ] Yanbo Liang commented on SPARK-4111: We had implement regression metrics such as

[jira] [Commented] (SPARK-4115) [GraphX] add overrided count for EdgeRDD

2014-10-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186518#comment-14186518 ] Apache Spark commented on SPARK-4115: - User 'luluorta' has created a pull request for

[jira] [Comment Edited] (SPARK-4111) [MLlib] Implement regression model evaluation metrics

2014-10-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186514#comment-14186514 ] Yanbo Liang edited comment on SPARK-4111 at 10/28/14 7:37 AM: --

[jira] [Created] (SPARK-4116) Delete the abandoned log4j-spark-container.properties

2014-10-28 Thread WangTaoTheTonic (JIRA)
WangTaoTheTonic created SPARK-4116: -- Summary: Delete the abandoned log4j-spark-container.properties Key: SPARK-4116 URL: https://issues.apache.org/jira/browse/SPARK-4116 Project: Spark

[jira] [Commented] (SPARK-4116) Delete the abandoned log4j-spark-container.properties

2014-10-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186641#comment-14186641 ] Apache Spark commented on SPARK-4116: - User 'WangTaoTheTonic' has created a pull

[jira] [Commented] (SPARK-4038) Outlier Detection Algorithm for MLlib

2014-10-28 Thread Ashutosh Trivedi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186656#comment-14186656 ] Ashutosh Trivedi commented on SPARK-4038: - tagging [~Kaushik619] As he is also

[jira] [Commented] (SPARK-2335) k-Nearest Neighbor classification and regression for MLLib

2014-10-28 Thread Ashutosh Trivedi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186659#comment-14186659 ] Ashutosh Trivedi commented on SPARK-2335: - Thanks [~bgawalt] and [~slcclimber] for

[jira] [Commented] (SPARK-4111) [MLlib] Implement regression model evaluation metrics

2014-10-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186710#comment-14186710 ] Yanbo Liang commented on SPARK-4111: https://github.com/apache/spark/pull/2978

[jira] [Commented] (SPARK-4111) [MLlib] Implement regression model evaluation metrics

2014-10-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186741#comment-14186741 ] Apache Spark commented on SPARK-4111: - User 'yanbohappy' has created a pull request

[jira] [Resolved] (SPARK-4095) [YARN][Minor]extract val isLaunchingDriver in ClientBase

2014-10-28 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-4095. -- Resolution: Fixed Fix Version/s: 1.2.0 [YARN][Minor]extract val isLaunchingDriver in

[jira] [Updated] (SPARK-4108) Fix uses of @deprecated in catalyst dataTypes

2014-10-28 Thread Anant Daksh Asthana (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anant Daksh Asthana updated SPARK-4108: --- Component/s: SQL Fix uses of @deprecated in catalyst dataTypes

[jira] [Commented] (SPARK-3611) Show number of cores for each executor in application web UI

2014-10-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186909#comment-14186909 ] Apache Spark commented on SPARK-3611: - User 'devldevelopment' has created a pull

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-10-28 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186910#comment-14186910 ] zzc commented on SPARK-2468: Hi，Reynold Xin, What time does this issue can be solved? I need

[jira] [Resolved] (SPARK-4098) use appUIAddress instead of appUIHostPort in yarn-client mode

2014-10-28 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-4098. -- Resolution: Fixed Fix Version/s: 1.2.0 use appUIAddress instead of appUIHostPort in

[jira] [Commented] (SPARK-2335) k-Nearest Neighbor classification and regression for MLLib

2014-10-28 Thread Kaushik Ranjan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186954#comment-14186954 ] Kaushik Ranjan commented on SPARK-2335: --- Hi [~bgawalt]. For evaluation of KNN-join,

[jira] [Commented] (SPARK-3561) Allow for pluggable execution contexts in Spark

2014-10-28 Thread Oleg Zhurakousky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186987#comment-14186987 ] Oleg Zhurakousky commented on SPARK-3561: - [~vanzin] I would not call it hard (we

[jira] [Commented] (SPARK-3657) yarn alpha YarnRMClientImpl throws NPE appMasterRequest.setTrackingUrl starting spark-shell

2014-10-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187070#comment-14187070 ] Apache Spark commented on SPARK-3657: - User 'sarutak' has created a pull request for

[jira] [Resolved] (SPARK-4031) Read broadcast variables on use

2014-10-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-4031. -- Resolution: Fixed Fix Version/s: 1.2.0 Read broadcast variables on use

[jira] [Commented] (SPARK-4031) Read broadcast variables on use

2014-10-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187122#comment-14187122 ] Shivaram Venkataraman commented on SPARK-4031: -- Issue resolved by pull

[jira] [Created] (SPARK-4118) Create python bindings for Streaming KMeans

2014-10-28 Thread Anant Daksh Asthana (JIRA)
Anant Daksh Asthana created SPARK-4118: -- Summary: Create python bindings for Streaming KMeans Key: SPARK-4118 URL: https://issues.apache.org/jira/browse/SPARK-4118 Project: Spark Issue

[jira] [Created] (SPARK-4119) Don't rely on HIVE_DEV_HOME to find .q files

2014-10-28 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-4119: - Summary: Don't rely on HIVE_DEV_HOME to find .q files Key: SPARK-4119 URL: https://issues.apache.org/jira/browse/SPARK-4119 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-10-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187183#comment-14187183 ] Reynold Xin commented on SPARK-2468: Scheduled to go in in 1.2. Netty-based block

[jira] [Created] (SPARK-4120) Join of multiple tables with syntax like SELECT .. FROM T1,T2,T3.. does not work in SparkSQL

2014-10-28 Thread Ravindra Pesala (JIRA)
Ravindra Pesala created SPARK-4120: -- Summary: Join of multiple tables with syntax like SELECT .. FROM T1,T2,T3.. does not work in SparkSQL Key: SPARK-4120 URL: https://issues.apache.org/jira/browse/SPARK-4120

[jira] [Closed] (SPARK-4110) Wrong comments about default settings in spark-daemon.sh

2014-10-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4110. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Assignee:

[jira] [Resolved] (SPARK-4107) Incorrect handling of Channel.read()'s return value may lead to data truncation

2014-10-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-4107. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Incorrect handling of

[jira] [Updated] (SPARK-4096) let ApplicationMaster accept executor memory argument in same format as JVM memory strings

2014-10-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4096: - Affects Version/s: 1.1.0 let ApplicationMaster accept executor memory argument in same format as JVM

[jira] [Closed] (SPARK-4096) let ApplicationMaster accept executor memory argument in same format as JVM memory strings

2014-10-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4096. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: WangTaoTheTonic Target

[jira] [Closed] (SPARK-3657) yarn alpha YarnRMClientImpl throws NPE appMasterRequest.setTrackingUrl starting spark-shell

2014-10-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3657. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Kousuke Saruta yarn alpha

[jira] [Closed] (SPARK-4089) The version number of Spark in _config.yaml is wrong.

2014-10-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4089. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Kousuke Saruta The version number of

[jira] [Closed] (SPARK-4065) pyspark will not use ipython on Windows

2014-10-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4065. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Target Version/s: 1.1.1,

[jira] [Updated] (SPARK-4065) pyspark will not use ipython on Windows

2014-10-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4065: - Assignee: Michael Griffiths pyspark will not use ipython on Windows

[jira] [Commented] (SPARK-4048) Enhance and extend hadoop-provided profile

2014-10-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187355#comment-14187355 ] Apache Spark commented on SPARK-4048: - User 'vanzin' has created a pull request for

[jira] [Closed] (SPARK-4058) Log file name is hard coded even though there is a variable '$LOG_FILE '

2014-10-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4058. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Kousuke Saruta Log file name is hard

[jira] [Resolved] (SPARK-3814) Support for Bitwise AND(), OR(|) ,XOR(^), NOT(~) in Spark HQL and SQL

2014-10-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3814. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2961

[jira] [Resolved] (SPARK-3988) Public API for DateType support

2014-10-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3988. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2901

[jira] [Created] (SPARK-4121) Master build failures after shading commons-math3

2014-10-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-4121: Summary: Master build failures after shading commons-math3 Key: SPARK-4121 URL: https://issues.apache.org/jira/browse/SPARK-4121 Project: Spark Issue Type:

[jira] [Updated] (SPARK-4121) Master build failures after shading commons-math3

2014-10-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4121: - Component/s: MLlib Build Master build failures after shading commons-math3

[jira] [Updated] (SPARK-4121) Master build failures after shading commons-math3

2014-10-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4121: - Description: The Spark master Maven build kept failing after we replace colt with commons-math3

[jira] [Commented] (SPARK-4121) Master build failures after shading commons-math3

2014-10-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187453#comment-14187453 ] Patrick Wendell commented on SPARK-4121: [~srowen] - can you help with this? This

[jira] [Commented] (SPARK-4121) Master build failures after shading commons-math3

2014-10-28 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187458#comment-14187458 ] Josh Rosen commented on SPARK-4121: --- Here's an easy command to reproduce this: {code}

[jira] [Created] (SPARK-4122) Add library to write data back to Kafka

2014-10-28 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created SPARK-4122: --- Summary: Add library to write data back to Kafka Key: SPARK-4122 URL: https://issues.apache.org/jira/browse/SPARK-4122 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

2014-10-28 Thread Michael Griffiths (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187471#comment-14187471 ] Michael Griffiths commented on SPARK-3398: -- I'm running into an issue with

[jira] [Comment Edited] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

2014-10-28 Thread Michael Griffiths (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187471#comment-14187471 ] Michael Griffiths edited comment on SPARK-3398 at 10/28/14 9:10 PM:

[jira] [Commented] (SPARK-4121) Master build failures after shading commons-math3

2014-10-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187475#comment-14187475 ] Sean Owen commented on SPARK-4121: -- Yeah I was seeing this locally, but not on the

[jira] [Resolved] (SPARK-3922) A global UTF8 constant for Spark

2014-10-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-3922. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Shixiong Zhu A global UTF8

[jira] [Resolved] (SPARK-3343) Support for CREATE TABLE AS SELECT that specifies the format

2014-10-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3343. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2570

[jira] [Updated] (SPARK-2335) k-Nearest Neighbor classification and regression for MLLib

2014-10-28 Thread Brian Gawalt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Gawalt updated SPARK-2335: Labels: features (was: features newbie) k-Nearest Neighbor classification and regression for

[jira] [Commented] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

2014-10-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187519#comment-14187519 ] Nicholas Chammas commented on SPARK-3398: - [~michael.griffiths] -

[jira] [Commented] (SPARK-3683) PySpark Hive query generates NULL instead of None

2014-10-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187537#comment-14187537 ] Michael Armbrust commented on SPARK-3683: - [~davies] there used to be some

[jira] [Commented] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

2014-10-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187553#comment-14187553 ] Nicholas Chammas commented on SPARK-3398: - Hmm, I'm curious: # Why did you have to

[jira] [Commented] (SPARK-3683) PySpark Hive query generates NULL instead of None

2014-10-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187563#comment-14187563 ] Davies Liu commented on SPARK-3683: --- This commit remove the special case for NULL:

[jira] [Commented] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

2014-10-28 Thread Michael Griffiths (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187566#comment-14187566 ] Michael Griffiths commented on SPARK-3398: -- In order - # I tried a few times;

[jira] [Commented] (SPARK-3683) PySpark Hive query generates NULL instead of None

2014-10-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187570#comment-14187570 ] Michael Armbrust commented on SPARK-3683: - Good find! [~jamborta] if you can give

[jira] [Created] (SPARK-4123) Show new dependencies added in pull requests

2014-10-28 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-4123: -- Summary: Show new dependencies added in pull requests Key: SPARK-4123 URL: https://issues.apache.org/jira/browse/SPARK-4123 Project: Spark Issue Type:

[jira] [Updated] (SPARK-4123) Show new dependencies added in pull requests

2014-10-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4123: --- Description: We should inspect the classpath of Spark's assembly jar for every pull request.

[jira] [Resolved] (SPARK-4084) Reuse sort key in Sorter

2014-10-28 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson resolved SPARK-4084. --- Resolution: Fixed Fix Version/s: 1.2.0 Reuse sort key in Sorter

[jira] [Commented] (SPARK-4123) Show new dependencies added in pull requests

2014-10-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187590#comment-14187590 ] Patrick Wendell commented on SPARK-4123: [~nchammas] - do you have any interest in

[jira] [Commented] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

2014-10-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187593#comment-14187593 ] Nicholas Chammas commented on SPARK-3398: - OK, so you're invoking {{spark-ec2}}

[jira] [Commented] (SPARK-4123) Show new dependencies added in pull requests

2014-10-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187598#comment-14187598 ] Nicholas Chammas commented on SPARK-4123: - Sure thing, [~pwendell], though I will

[jira] [Created] (SPARK-4124) Simplify serialization and call API in MLlib Python

2014-10-28 Thread Davies Liu (JIRA)
Davies Liu created SPARK-4124: - Summary: Simplify serialization and call API in MLlib Python Key: SPARK-4124 URL: https://issues.apache.org/jira/browse/SPARK-4124 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3930) Add precision and scale to Spark SQL's Decimal type

2014-10-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187666#comment-14187666 ] Apache Spark commented on SPARK-3930: - User 'mateiz' has created a pull request for

[jira] [Commented] (SPARK-3933) Optimize decimal type in Spark SQL for those with small precision

2014-10-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187667#comment-14187667 ] Apache Spark commented on SPARK-3933: - User 'mateiz' has created a pull request for

[jira] [Commented] (SPARK-3683) PySpark Hive query generates NULL instead of None

2014-10-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187757#comment-14187757 ] Cheng Lian commented on SPARK-3683: --- [~davies] I removed this special case for NULL

[jira] [Commented] (SPARK-3862) MultiWayBroadcastInnerHashJoin

2014-10-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187759#comment-14187759 ] Apache Spark commented on SPARK-3862: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-2215) Multi-way join

2014-10-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187798#comment-14187798 ] Reynold Xin commented on SPARK-2215: I think a simplified version of the multi-way

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-10-28 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187832#comment-14187832 ] zzc commented on SPARK-2468: Hi，Reynold Xin, When version 1.2 released, approximate time?

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-10-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187837#comment-14187837 ] Reynold Xin commented on SPARK-2468: Take a look here

[jira] [Commented] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

2014-10-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187861#comment-14187861 ] Nicholas Chammas commented on SPARK-3398: - So I spun up an Ubuntu server on EC2

[jira] [Updated] (SPARK-3466) Limit size of results that a driver collects for each action

2014-10-28 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-3466: - Priority: Critical (was: Major) Limit size of results that a driver collects for each action

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

2014-10-28 Thread zzc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187881#comment-14187881 ] zzc commented on SPARK-2468: thanks Netty-based block server / client module

[jira] [Commented] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

2014-10-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187898#comment-14187898 ] Nicholas Chammas commented on SPARK-3398: - I think I've found the issue. It

[jira] [Commented] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

2014-10-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187900#comment-14187900 ] Nicholas Chammas commented on SPARK-3398: - If that fixes it for you, then I think

[jira] [Resolved] (SPARK-3904) HQL doesn't support the ConstantObjectInspector to pass into UDFs

2014-10-28 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3904. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2762

[jira] [Created] (SPARK-4127) Streaming Linear Regression

2014-10-28 Thread Anant Daksh Asthana (JIRA)
Anant Daksh Asthana created SPARK-4127: -- Summary: Streaming Linear Regression Key: SPARK-4127 URL: https://issues.apache.org/jira/browse/SPARK-4127 Project: Spark Issue Type:

[jira] [Commented] (SPARK-4127) Streaming Linear Regression

2014-10-28 Thread Anant Daksh Asthana (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187906#comment-14187906 ] Anant Daksh Asthana commented on SPARK-4127: [~mengxr] [~freeman-lab] Just

[jira] [Updated] (SPARK-4127) Streaming Linear Regression

2014-10-28 Thread Anant Daksh Asthana (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anant Daksh Asthana updated SPARK-4127: --- Description: Create python bindings for Streaming Linear Regression (MLlib). The

[jira] [Updated] (SPARK-4127) Streaming Linear Regression

2014-10-28 Thread Anant Daksh Asthana (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anant Daksh Asthana updated SPARK-4127: --- Description: Create python bindings for Streaming Linear Regression (MLlib). The

[jira] [Comment Edited] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

2014-10-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187900#comment-14187900 ] Nicholas Chammas edited comment on SPARK-3398 at 10/29/14 2:48 AM:

[jira] [Commented] (SPARK-4120) Join of multiple tables with syntax like SELECT .. FROM T1,T2,T3.. does not work in SparkSQL

2014-10-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187929#comment-14187929 ] Apache Spark commented on SPARK-4120: - User 'ravipesala' has created a pull request

[jira] [Resolved] (SPARK-4008) Fix kryo with fold in KryoSerializerSuite

2014-10-28 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-4008. - Resolution: Fixed Fix Version/s: 1.2.0 Fix kryo with fold in KryoSerializerSuite

[jira] [Closed] (SPARK-3008) PySpark fails due to zipimport not able to load the assembly jar (/usr/bin/python: No module named pyspark)

2014-10-28 Thread Jai Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jai Kumar Singh closed SPARK-3008. -- PySpark fails due to zipimport not able to load the assembly jar (/usr/bin/python: No module

[jira] [Updated] (SPARK-1442) Add Window function support

2014-10-28 Thread guowei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guowei updated SPARK-1442: -- Attachment: Window Function.pdf Add Window function support ---

[jira] [Commented] (SPARK-4094) checkpoint should still be available after rdd actions

2014-10-28 Thread Zhang, Liye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187982#comment-14187982 ] Zhang, Liye commented on SPARK-4094:

[jira] [Created] (SPARK-4128) Create instructions on fully building Spark in Intellij

2014-10-28 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-4128: -- Summary: Create instructions on fully building Spark in Intellij Key: SPARK-4128 URL: https://issues.apache.org/jira/browse/SPARK-4128 Project: Spark

[jira] [Commented] (SPARK-4062) Improve KafkaReceiver to prevent data loss

2014-10-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14188008#comment-14188008 ] Apache Spark commented on SPARK-4062: - User 'jerryshao' has created a pull request for

  1   2   >