[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648552#comment-14648552 ] Jeremy Freeman commented on SPARK-9461: --- Ah, great to hear! > Possibly slightly fla

[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647884#comment-14647884 ] Jeremy Freeman commented on SPARK-9461: --- Interesting, the lack of failures on KMeans

[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647220#comment-14647220 ] Jeremy Freeman commented on SPARK-9461: --- I'd definitely be curious to see if these t

[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647186#comment-14647186 ] Jeremy Freeman commented on SPARK-9461: --- A couple initial observations: - the Scala

[jira] [Commented] (SPARK-4144) Support incremental model training of Naive Bayes classifier

[ https://issues.apache.org/jira/browse/SPARK-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14642207#comment-14642207 ] Jeremy Freeman commented on SPARK-4144: --- Sorry Chris! Why don't you have a go, I'd b

[jira] [Commented] (SPARK-4980) Add decay factors to streaming linear methods

[ https://issues.apache.org/jira/browse/SPARK-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14640714#comment-14640714 ] Jeremy Freeman commented on SPARK-4980: --- That's terrific! Happy to have you work on

[jira] [Commented] (SPARK-6722) Model import/export for StreamingKMeansModel

[ https://issues.apache.org/jira/browse/SPARK-6722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14484772#comment-14484772 ] Jeremy Freeman commented on SPARK-6722: --- [~josephkb] Good question! Agreed it would

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390176#comment-14390176 ] Jeremy Freeman commented on SPARK-6646: --- Very promising [~tdas]! We should evaluate

[jira] [Updated] (SPARK-6345) Model update propagation during prediction in Streaming Regression

[ https://issues.apache.org/jira/browse/SPARK-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-6345: -- Description: During streaming regression analyses (Streaming Linear Regression and Streaming Lo

[jira] [Updated] (SPARK-6345) Model update propagation during prediction in Streaming Regression

[ https://issues.apache.org/jira/browse/SPARK-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-6345: -- Description: During streaming regression analyses (Streaming Linear Regression and Streaming Lo

[jira] [Updated] (SPARK-6345) Model update propagation during prediction in Streaming Regression

[ https://issues.apache.org/jira/browse/SPARK-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-6345: -- Description: During streaming regression analyses (Streaming Linear Regression and Streaming Lo

[jira] [Updated] (SPARK-6345) Model update propagation during prediction in Streaming Regression

[ https://issues.apache.org/jira/browse/SPARK-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-6345: -- Description: During streaming regression analyses (Streaming Linear Regression and Streaming Lo

[jira] [Updated] (SPARK-6345) Model update propagation during prediction in Streaming Regression

[ https://issues.apache.org/jira/browse/SPARK-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-6345: -- Description: During streaming regression analyses (Streaming Linear Regression and Streaming Lo

[jira] [Updated] (SPARK-6345) Model update propagation during prediction in Streaming Regression

[ https://issues.apache.org/jira/browse/SPARK-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-6345: -- Description: During streaming regression analyses (Streaming Linear Regression and Streaming Lo

[jira] [Created] (SPARK-6345) Model update propagation during prediction in Streaming Regression

Jeremy Freeman created SPARK-6345: - Summary: Model update propagation during prediction in Streaming Regression Key: SPARK-6345 URL: https://issues.apache.org/jira/browse/SPARK-6345 Project: Spark

[jira] [Comment Edited] (SPARK-2429) Hierarchical Implementation of KMeans

[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14357497#comment-14357497 ] Jeremy Freeman edited comment on SPARK-2429 at 3/11/15 8:10 PM:

[jira] [Commented] (SPARK-2429) Hierarchical Implementation of KMeans

[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14357497#comment-14357497 ] Jeremy Freeman commented on SPARK-2429: --- Thanks for the update and contribution [~yu

[jira] [Commented] (SPARK-4144) Support incremental model training of Naive Bayes classifier

[ https://issues.apache.org/jira/browse/SPARK-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14328726#comment-14328726 ] Jeremy Freeman commented on SPARK-4144: --- Hi all, I'd be happy to pick this up and ge

[jira] [Updated] (SPARK-5089) Vector conversion broken for non-float64 arrays

[ https://issues.apache.org/jira/browse/SPARK-5089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-5089: -- Description: Prior to performing many MLlib operations in PySpark (e.g. KMeans), data are autom

[jira] [Updated] (SPARK-5089) Vector conversion broken for non-float64 arrays

[ https://issues.apache.org/jira/browse/SPARK-5089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-5089: -- Description: Prior to performing many MLlib operations in PySpark (e.g. KMeans), data are autom

[jira] [Updated] (SPARK-5089) Vector conversion broken for non-float64 arrays

[ https://issues.apache.org/jira/browse/SPARK-5089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-5089: -- Description: Prior to performing many MLlib operations in PySpark (e.g. KMeans), data are autom

[jira] [Created] (SPARK-5089) Vector conversion broken for non-float64 arrays

Jeremy Freeman created SPARK-5089: - Summary: Vector conversion broken for non-float64 arrays Key: SPARK-5089 URL: https://issues.apache.org/jira/browse/SPARK-5089 Project: Spark Issue Type: B

[jira] [Created] (SPARK-4981) Add a streaming singular value decomposition

Jeremy Freeman created SPARK-4981: - Summary: Add a streaming singular value decomposition Key: SPARK-4981 URL: https://issues.apache.org/jira/browse/SPARK-4981 Project: Spark Issue Type: New

[jira] [Created] (SPARK-4980) Add decay factors to streaming linear methods

Jeremy Freeman created SPARK-4980: - Summary: Add decay factors to streaming linear methods Key: SPARK-4980 URL: https://issues.apache.org/jira/browse/SPARK-4980 Project: Spark Issue Type: New

[jira] [Created] (SPARK-4979) Add streaming logistic regression

Jeremy Freeman created SPARK-4979: - Summary: Add streaming logistic regression Key: SPARK-4979 URL: https://issues.apache.org/jira/browse/SPARK-4979 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-4969) Add binaryRecords support to streaming

Jeremy Freeman created SPARK-4969: - Summary: Add binaryRecords support to streaming Key: SPARK-4969 URL: https://issues.apache.org/jira/browse/SPARK-4969 Project: Spark Issue Type: Improvemen

[jira] [Commented] (SPARK-4727) Add "dimensional" RDDs (time series, spatial)

[ https://issues.apache.org/jira/browse/SPARK-4727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14234269#comment-14234269 ] Jeremy Freeman commented on SPARK-4727: --- Great to brainstorm about this RJ! To som

[jira] [Commented] (SPARK-3995) [PYSPARK] PySpark's sample methods do not work with NumPy 1.9

[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227266#comment-14227266 ] Jeremy Freeman commented on SPARK-3995: --- Agree with [~mengxr], that's a better strat

[jira] [Commented] (SPARK-3254) Streaming K-Means

[ https://issues.apache.org/jira/browse/SPARK-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14181080#comment-14181080 ] Jeremy Freeman commented on SPARK-3254: --- I'd like it to! I've got a PR ready to subm

[jira] [Updated] (SPARK-3995) [PYSPARK] PySpark's sample methods do not work with NumPy 1.9

[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9. Th

[jira] [Updated] (SPARK-3995) [PYSPARK] PySpark's sample methods do not work with NumPy 1.9

[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9. Th

[jira] [Updated] (SPARK-3995) [PYSPARK] PySpark's sample methods do not work with NumPy 1.9

[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9. Th

[jira] [Updated] (SPARK-3995) [PYSPARK] PySpark's sample methods do not work with NumPy 1.9

[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9. Th

[jira] [Updated] (SPARK-3995) [PYSPARK] PySpark's sample methods do not work with NumPy 1.9

[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9. Th

[jira] [Updated] (SPARK-3995) [PYSPARK] PySpark's sample methods do not work with NumPy 1.9

[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Summary: [PYSPARK] PySpark's sample methods do not work with NumPy 1.9 (was: pyspark's sample m

[jira] [Updated] (SPARK-3995) pyspark's sample methods do not work with NumPy 1.9

[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9. Th

[jira] [Updated] (SPARK-3995) pyspark's sample methods do not work with NumPy 1.9

[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9. Th

[jira] [Created] (SPARK-3995) pyspark's sample methods do not work with NumPy 1.9

Jeremy Freeman created SPARK-3995: - Summary: pyspark's sample methods do not work with NumPy 1.9 Key: SPARK-3995 URL: https://issues.apache.org/jira/browse/SPARK-3995 Project: Spark Issue Typ

[jira] [Comment Edited] (SPARK-3254) Streaming K-Means

[ https://issues.apache.org/jira/browse/SPARK-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114299#comment-14114299 ] Jeremy Freeman edited comment on SPARK-3254 at 8/28/14 8:38 PM:

[jira] [Commented] (SPARK-3254) Streaming K-Means

[ https://issues.apache.org/jira/browse/SPARK-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114299#comment-14114299 ] Jeremy Freeman commented on SPARK-3254: --- Here is a (public) google doc explaining a

[jira] [Created] (SPARK-3128) Use streaming test suite for StreamingLR

Jeremy Freeman created SPARK-3128: - Summary: Use streaming test suite for StreamingLR Key: SPARK-3128 URL: https://issues.apache.org/jira/browse/SPARK-3128 Project: Spark Issue Type: Improvem

[jira] [Commented] (SPARK-2012) PySpark StatCounter with numpy arrays

[ https://issues.apache.org/jira/browse/SPARK-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14079984#comment-14079984 ] Jeremy Freeman commented on SPARK-2012: --- [~davies] cool, that definitely makes sense

[jira] [Comment Edited] (SPARK-2282) PySpark crashes if too many tasks complete quickly

[ https://issues.apache.org/jira/browse/SPARK-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069758#comment-14069758 ] Jeremy Freeman edited comment on SPARK-2282 at 7/22/14 3:18 AM:

[jira] [Commented] (SPARK-2282) PySpark crashes if too many tasks complete quickly

[ https://issues.apache.org/jira/browse/SPARK-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069758#comment-14069758 ] Jeremy Freeman commented on SPARK-2282: --- Hi all, I'm "the scientist", a couple updat

[jira] [Created] (SPARK-2438) Streaming + MLLib

Jeremy Freeman created SPARK-2438: - Summary: Streaming + MLLib Key: SPARK-2438 URL: https://issues.apache.org/jira/browse/SPARK-2438 Project: Spark Issue Type: Improvement Component

[jira] [Created] (SPARK-2012) PySpark StatCounter with numpy arrays

Jeremy Freeman created SPARK-2012: - Summary: PySpark StatCounter with numpy arrays Key: SPARK-2012 URL: https://issues.apache.org/jira/browse/SPARK-2012 Project: Spark Issue Type: Improvement