[jira] [Comment Edited] (SPARK-5483) java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;

2015-01-30 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298823#comment-14298823 ] DeepakVohra edited comment on SPARK-5483 at 1/30/15 4:39 PM: -

[jira] [Resolved] (SPARK-5483) java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;

2015-01-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5483. -- Resolution: Not a Problem These too are clearly in the 2.10 artifact. Download it and grep for them.

[jira] [Comment Edited] (SPARK-5483) java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;

2015-01-30 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298823#comment-14298823 ] DeepakVohra edited comment on SPARK-5483 at 1/30/15 4:41 PM: -

[jira] [Updated] (SPARK-3454) Expose JSON representation of data shown in WebUI

2015-01-30 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-3454: Attachment: sparkmonitoringjsondesign.pdf Expose JSON representation of data shown in WebUI

[jira] [Resolved] (SPARK-5393) Flood of util.RackResolver log messages after SPARK-1714

2015-01-30 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-5393. -- Resolution: Fixed Fix Version/s: 1.3.0 Flood of util.RackResolver log messages after

[jira] [Comment Edited] (SPARK-5489) KMeans clustering java.lang.NoSuchMethodError: scala.runtime.IntRef.create (I)Lscala/runtime/IntRef;

2015-01-30 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298824#comment-14298824 ] DeepakVohra edited comment on SPARK-5489 at 1/30/15 4:40 PM: -

[jira] [Commented] (SPARK-5491) Chi-square feature selection

2015-01-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298855#comment-14298855 ] Apache Spark commented on SPARK-5491: - User 'avulanov' has created a pull request for

[jira] [Commented] (SPARK-3778) newAPIHadoopRDD doesn't properly pass credentials for secure hdfs on yarn

2015-01-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298872#comment-14298872 ] Apache Spark commented on SPARK-3778: - User 'tgravescs' has created a pull request for

[jira] [Commented] (SPARK-3454) Expose JSON representation of data shown in WebUI

2015-01-30 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298747#comment-14298747 ] Imran Rashid commented on SPARK-3454: - design doc attached, would love any feedback

[jira] [Commented] (SPARK-5400) Rename GaussianMixtureEM to GaussianMixture

2015-01-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298762#comment-14298762 ] Apache Spark commented on SPARK-5400: - User 'tgaloppo' has created a pull request for

[jira] [Resolved] (SPARK-5267) Add a streaming module to ingest Apache Camel Messages from a configured endpoints

2015-01-30 Thread Steve Brewin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Brewin resolved SPARK-5267. - Resolution: Done Code submitted to Spark Packages @ http://spark-packages.org/package/29,

[jira] [Commented] (SPARK-5489) KMeans clustering java.lang.NoSuchMethodError: scala.runtime.IntRef.create (I)Lscala/runtime/IntRef;

2015-01-30 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298824#comment-14298824 ] DeepakVohra commented on SPARK-5489: The issue is with the Maven dependency dependency

[jira] [Comment Edited] (SPARK-5489) KMeans clustering java.lang.NoSuchMethodError: scala.runtime.IntRef.create (I)Lscala/runtime/IntRef;

2015-01-30 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298824#comment-14298824 ] DeepakVohra edited comment on SPARK-5489 at 1/30/15 4:40 PM: -

[jira] [Commented] (SPARK-5483) java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;

2015-01-30 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298823#comment-14298823 ] DeepakVohra commented on SPARK-5483: The issue is with the Maven dependency dependency

[jira] [Created] (SPARK-5502) User guide for isotonic regression

2015-01-30 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-5502: Summary: User guide for isotonic regression Key: SPARK-5502 URL: https://issues.apache.org/jira/browse/SPARK-5502 Project: Spark Issue Type: Documentation

[jira] [Comment Edited] (SPARK-5483) java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;

2015-01-30 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299009#comment-14299009 ] DeepakVohra edited comment on SPARK-5483 at 1/30/15 6:30 PM: -

[jira] [Commented] (SPARK-2335) k-Nearest Neighbor classification and regression for MLLib

2015-01-30 Thread Brian Gawalt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299093#comment-14299093 ] Brian Gawalt commented on SPARK-2335: - I'm inclined to wonder the same thing;

[jira] [Commented] (SPARK-5501) Write support for the data source API

2015-01-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299207#comment-14299207 ] Apache Spark commented on SPARK-5501: - User 'yhuai' has created a pull request for

[jira] [Resolved] (SPARK-5486) Add validate function for BlockMatrix

2015-01-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5486. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4279

[jira] [Updated] (SPARK-5486) Add validate function for BlockMatrix

2015-01-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5486: - Assignee: Burak Yavuz Add validate function for BlockMatrix

[jira] [Updated] (SPARK-5501) Write support for the data source API

2015-01-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-5501: Summary: Write support for the data source API (was: Initial Write support) Write support for the data

[jira] [Created] (SPARK-5503) Example code for Power Iteration Clustering

2015-01-30 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-5503: Summary: Example code for Power Iteration Clustering Key: SPARK-5503 URL: https://issues.apache.org/jira/browse/SPARK-5503 Project: Spark Issue Type:

[jira] [Created] (SPARK-5504) ScalaReflection.convertToCatalyst should support nested arrays

2015-01-30 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-5504: Summary: ScalaReflection.convertToCatalyst should support nested arrays Key: SPARK-5504 URL: https://issues.apache.org/jira/browse/SPARK-5504 Project: Spark

[jira] [Updated] (SPARK-5503) Example code for Power Iteration Clustering

2015-01-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5503: - Description: There are two places we need to put examples: 1. In the user guide, we should be a

[jira] [Resolved] (SPARK-4259) Add Power Iteration Clustering Algorithm with Gaussian Similarity Function

2015-01-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4259. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4254

[jira] [Commented] (SPARK-5504) ScalaReflection.convertToCatalyst should support nested arrays

2015-01-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299291#comment-14299291 ] Apache Spark commented on SPARK-5504: - User 'jkbradley' has created a pull request for

[jira] [Comment Edited] (SPARK-5483) java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;

2015-01-30 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299009#comment-14299009 ] DeepakVohra edited comment on SPARK-5483 at 1/30/15 6:31 PM: -

[jira] [Commented] (SPARK-5500) Document that feeding hadoopFile into a shuffle operation will cause problems

2015-01-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299199#comment-14299199 ] Apache Spark commented on SPARK-5500: - User 'sryza' has created a pull request for

[jira] [Resolved] (SPARK-4846) When the vocabulary size is large, Word2Vec may yield OutOfMemoryError: Requested array size exceeds VM limit

2015-01-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4846. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4247

[jira] [Commented] (SPARK-5483) java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;

2015-01-30 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299009#comment-14299009 ] DeepakVohra commented on SPARK-5483: Is the Maven dependency spark-mllib_2.10 not a

[jira] [Commented] (SPARK-5489) KMeans clustering java.lang.NoSuchMethodError: scala.runtime.IntRef.create (I)Lscala/runtime/IntRef;

2015-01-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299006#comment-14299006 ] Sean Owen commented on SPARK-5489: -- But that *is* the artifact, which you see has the

[jira] [Commented] (SPARK-4259) Add Power Iteration Clustering Algorithm with Gaussian Similarity Function

2015-01-30 Thread Andrew Musselman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299065#comment-14299065 ] Andrew Musselman commented on SPARK-4259: - Makes sense; does that pull request

[jira] [Updated] (SPARK-5197) Support external shuffle service in fine-grained mode on mesos cluster

2015-01-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5197: --- Fix Version/s: (was: 1.3.0) Support external shuffle service in fine-grained mode on

[jira] [Created] (SPARK-5501) Initial Write support

2015-01-30 Thread Yin Huai (JIRA)
Yin Huai created SPARK-5501: --- Summary: Initial Write support Key: SPARK-5501 URL: https://issues.apache.org/jira/browse/SPARK-5501 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Comment Edited] (SPARK-5483) java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;

2015-01-30 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299009#comment-14299009 ] DeepakVohra edited comment on SPARK-5483 at 1/30/15 7:09 PM: -

[jira] [Created] (SPARK-5500) Document that feeding hadoopFile into a shuffle operation will cause problems

2015-01-30 Thread Sandy Ryza (JIRA)
Sandy Ryza created SPARK-5500: - Summary: Document that feeding hadoopFile into a shuffle operation will cause problems Key: SPARK-5500 URL: https://issues.apache.org/jira/browse/SPARK-5500 Project: Spark

[jira] [Updated] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

2015-01-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1517: --- Target Version/s: 1.4.0 Publish nightly snapshots of documentation, maven artifacts, and

[jira] [Updated] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

2015-01-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1517: --- Target Version/s: (was: 1.3.0) Publish nightly snapshots of documentation, maven

[jira] [Commented] (SPARK-4259) Add Power Iteration Clustering Algorithm with Gaussian Similarity Function

2015-01-30 Thread Stephen Boesch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299092#comment-14299092 ] Stephen Boesch commented on SPARK-4259: --- Yes the PR has a working version . However

[jira] [Resolved] (SPARK-5400) Rename GaussianMixtureEM to GaussianMixture

2015-01-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5400. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4290

[jira] [Commented] (SPARK-5483) java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;

2015-01-30 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299571#comment-14299571 ] DeepakVohra commented on SPARK-5483: To test: 1. Create a Maven project in Eclipse

[jira] [Closed] (SPARK-5299) Is http://www.apache.org/dist/spark/KEYS out of date?

2015-01-30 Thread David Shaw (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Shaw closed SPARK-5299. - Verified that key used to sign release is now present. Thanks. Is http://www.apache.org/dist/spark/KEYS

[jira] [Created] (SPARK-5505) ConsumerRebalanceFailedException from Kafka consumer

2015-01-30 Thread Greg Temchenko (JIRA)
Greg Temchenko created SPARK-5505: - Summary: ConsumerRebalanceFailedException from Kafka consumer Key: SPARK-5505 URL: https://issues.apache.org/jira/browse/SPARK-5505 Project: Spark Issue

[jira] [Resolved] (SPARK-5504) ScalaReflection.convertToCatalyst should support nested arrays

2015-01-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5504. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4295

[jira] [Commented] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-01-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299642#comment-14299642 ] Reynold Xin commented on SPARK-5472: [~chinnitv], thanks for commenting. The existing

[jira] [Commented] (SPARK-2614) Add the spark-examples-xxx-.jar to the Debian packages created with mvn ... -Pdeb (using assembly/pom.xml)

2015-01-30 Thread Christian Tzolov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299668#comment-14299668 ] Christian Tzolov commented on SPARK-2614: - Not sure if this issue is still alive?

[jira] [Commented] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-01-30 Thread Anand Mohan Tumuluri (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299633#comment-14299633 ] Anand Mohan Tumuluri commented on SPARK-5472: - Pardon my ignorance but I think

[jira] [Commented] (SPARK-4981) Add a streaming singular value decomposition

2015-01-30 Thread Reza Zadeh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299666#comment-14299666 ] Reza Zadeh commented on SPARK-4981: --- To be model parallel, we can simply warm-start the

[jira] [Comment Edited] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-01-30 Thread Tor Myklebust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299657#comment-14299657 ] Tor Myklebust edited comment on SPARK-5472 at 1/31/15 4:12 AM:

[jira] [Commented] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-01-30 Thread Tor Myklebust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299657#comment-14299657 ] Tor Myklebust commented on SPARK-5472: -- You appear to understand the issue perfectly.

[jira] [Updated] (SPARK-5472) Add support for reading from and writing to a JDBC database

2015-01-30 Thread Tor Myklebust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tor Myklebust updated SPARK-5472: - Description: It would be nice to be able to make a table in a JDBC database appear as a table in

[jira] [Commented] (SPARK-4981) Add a streaming singular value decomposition

2015-01-30 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299682#comment-14299682 ] Tathagata Das commented on SPARK-4981: -- +1 This will be awesome :P Add a streaming

[jira] [Commented] (SPARK-1010) Update all unit tests to use SparkConf instead of system properties

2015-01-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299683#comment-14299683 ] Josh Rosen commented on SPARK-1010: --- The pull request for SPARK-5425 fixes a bug in the

[jira] [Created] (SPARK-5506) java.lang.ClassCastException using lambda expressions in combination of spark and Servlet

2015-01-30 Thread Milad Khajavi (JIRA)
Milad Khajavi created SPARK-5506: Summary: java.lang.ClassCastException using lambda expressions in combination of spark and Servlet Key: SPARK-5506 URL: https://issues.apache.org/jira/browse/SPARK-5506

[jira] [Updated] (SPARK-3694) Allow printing object graph of tasks/RDD's with a debug flag

2015-01-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3694: --- Fix Version/s: 1.3.0 Allow printing object graph of tasks/RDD's with a debug flag

[jira] [Updated] (SPARK-3694) Allow printing object graph of tasks/RDD's with a debug flag

2015-01-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3694: --- Target Version/s: 1.3.0 (was: 1.2.0) Allow printing object graph of tasks/RDD's with a debug flag

[jira] [Commented] (SPARK-5307) Add utility to help with NotSerializableException debugging

2015-01-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299696#comment-14299696 ] Apache Spark commented on SPARK-5307: - User 'rxin' has created a pull request for this

[jira] [Resolved] (SPARK-5307) Add utility to help with NotSerializableException debugging

2015-01-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5307. Resolution: Fixed Fix Version/s: 1.3.0 Add utility to help with NotSerializableException

[jira] [Commented] (SPARK-5498) [SPARK-SQL]when the partition schema does not match table schema,it throws java.lang.ClassCastException and so on

2015-01-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298648#comment-14298648 ] Apache Spark commented on SPARK-5498: - User 'jeanlyn' has created a pull request for

[jira] [Commented] (SPARK-5495) Offer user the ability to kill application in master web UI for standalone mode

2015-01-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298415#comment-14298415 ] Apache Spark commented on SPARK-5495: - User 'jerryshao' has created a pull request for

[jira] [Created] (SPARK-5497) start-all script not working properly on Standalone HA cluster (with Zookeeper)

2015-01-30 Thread Roque Vassal'lo (JIRA)
Roque Vassal'lo created SPARK-5497: -- Summary: start-all script not working properly on Standalone HA cluster (with Zookeeper) Key: SPARK-5497 URL: https://issues.apache.org/jira/browse/SPARK-5497

[jira] [Commented] (SPARK-5428) Declare the 'assembly' module at the bottom of the modules element in the parent POM

2015-01-30 Thread Christian Tzolov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298412#comment-14298412 ] Christian Tzolov commented on SPARK-5428: - To verify this change i've tried to

[jira] [Resolved] (SPARK-5457) Add missing DSL for ApproxCountDistinct.

2015-01-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5457. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Takuya Ueshin Add missing DSL for

[jira] [Commented] (SPARK-5479) PySpark on yarn mode need to support non-local python files

2015-01-30 Thread Vladimir Grigor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298400#comment-14298400 ] Vladimir Grigor commented on SPARK-5479: https://github.com/apache/spark/pull/3976

[jira] [Created] (SPARK-5495) Offer user the ability to kill application in master web UI for standalone mode

2015-01-30 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-5495: -- Summary: Offer user the ability to kill application in master web UI for standalone mode Key: SPARK-5495 URL: https://issues.apache.org/jira/browse/SPARK-5495 Project:

[jira] [Updated] (SPARK-5495) Offer user the ability to kill application in master web UI for standalone mode

2015-01-30 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-5495: --- Description: For cluster admins or users who manage the whole cluster need to have the ability to

[jira] [Commented] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2015-01-30 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298351#comment-14298351 ] Guoqiang Li commented on SPARK-1405: Here is a sampling faster branch(work in

[jira] [Resolved] (SPARK-5378) There is no return results with 'select' operating on View

2015-01-30 Thread Adrian Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Wang resolved SPARK-5378. Resolution: Cannot Reproduce As we discussed offline, this should came up with a bug elsewhere, and

[jira] [Closed] (SPARK-5452) We are migrating Tera Data SQL to Spark SQL. Query is taking long time. Please have a look on this issue

2015-01-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-5452. Resolution: Not a Problem We are migrating Tera Data SQL to Spark SQL. Query is taking long time. Please

[jira] [Updated] (SPARK-5094) Python API for gradient-boosted trees

2015-01-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5094: - Fix Version/s: (was: 1.4.0) 1.3.0 Python API for gradient-boosted trees

[jira] [Resolved] (SPARK-5094) Python API for gradient-boosted trees

2015-01-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5094. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 3951

[jira] [Created] (SPARK-5496) Allow both classification and Classification in Algo for trees

2015-01-30 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-5496: Summary: Allow both classification and Classification in Algo for trees Key: SPARK-5496 URL: https://issues.apache.org/jira/browse/SPARK-5496 Project: Spark

[jira] [Commented] (SPARK-5496) Allow both classification and Classification in Algo for trees

2015-01-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298380#comment-14298380 ] Apache Spark commented on SPARK-5496: - User 'mengxr' has created a pull request for

[jira] [Comment Edited] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2015-01-30 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298351#comment-14298351 ] Guoqiang Li edited comment on SPARK-1405 at 1/30/15 8:33 AM: -

[jira] [Comment Edited] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

2015-01-30 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298351#comment-14298351 ] Guoqiang Li edited comment on SPARK-1405 at 1/30/15 8:34 AM: -

[jira] [Commented] (SPARK-5483) java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;

2015-01-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298600#comment-14298600 ] Sean Owen commented on SPARK-5483: -- The examples don't set a master on purpose, as I

[jira] [Commented] (SPARK-5499) iterative computing with 1000 iterations causes stage failure

2015-01-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298602#comment-14298602 ] Sean Owen commented on SPARK-5499: -- I think it's expected behavior, in the sense that you

[jira] [Updated] (SPARK-5499) iterative computing with 1000 iterations causes stage failure

2015-01-30 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tien-Dung LE updated SPARK-5499: Description: I got an error org.apache.spark.SparkException: Job aborted due to stage failure:

[jira] [Resolved] (SPARK-5428) Declare the 'assembly' module at the bottom of the modules element in the parent POM

2015-01-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5428. -- Resolution: Won't Fix Declare the 'assembly' module at the bottom of the modules element in the

[jira] [Commented] (SPARK-5499) iterative computing with 1000 iterations causes stage failure

2015-01-30 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298622#comment-14298622 ] Tien-Dung LE commented on SPARK-5499: - I tried with checkpoint() but same had the same

[jira] [Resolved] (SPARK-5489) KMeans clustering java.lang.NoSuchMethodError: scala.runtime.IntRef.create (I)Lscala/runtime/IntRef;

2015-01-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5489. -- Resolution: Duplicate Although it seems to be clearly a problem with mixing artifacts for different

[jira] [Created] (SPARK-5499) iterative computing with 1000 iterations causes stage failure

2015-01-30 Thread Tien-Dung LE (JIRA)
Tien-Dung LE created SPARK-5499: --- Summary: iterative computing with 1000 iterations causes stage failure Key: SPARK-5499 URL: https://issues.apache.org/jira/browse/SPARK-5499 Project: Spark

[jira] [Updated] (SPARK-5499) iterative computing with 1000 iterations causes stage failure

2015-01-30 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tien-Dung LE updated SPARK-5499: Description: I got an error org.apache.spark.SparkException: Job aborted due to stage failure:

[jira] [Commented] (SPARK-5499) iterative computing with 1000 iterations causes stage failure

2015-01-30 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298608#comment-14298608 ] Tien-Dung LE commented on SPARK-5499: - Thanks Sean Owen for your comment. Calling

[jira] [Commented] (SPARK-5499) iterative computing with 1000 iterations causes stage failure

2015-01-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298612#comment-14298612 ] Sean Owen commented on SPARK-5499: -- Ah, that may be right. persist() should also break

[jira] [Comment Edited] (SPARK-5499) iterative computing with 1000 iterations causes stage failure

2015-01-30 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298622#comment-14298622 ] Tien-Dung LE edited comment on SPARK-5499 at 1/30/15 1:47 PM: --

[jira] [Created] (SPARK-5498) [SPARK-SQL]when the partition schema does not match table schema,it throws java.lang.ClassCastException and so on

2015-01-30 Thread jeanlyn (JIRA)
jeanlyn created SPARK-5498: -- Summary: [SPARK-SQL]when the partition schema does not match table schema,it throws java.lang.ClassCastException and so on Key: SPARK-5498 URL:

[jira] [Commented] (SPARK-5185) pyspark --jars does not add classes to driver class path

2015-01-30 Thread Cristian Opris (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298576#comment-14298576 ] Cristian Opris commented on SPARK-5185: --- I have a similar possible issue. I need to