[jira] [Commented] (SPARK-9460) Avoid byte array allocation in StringPrefixComparator

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647305#comment-14647305 ] Apache Spark commented on SPARK-9460: - User 'rxin' has created a pull request for this

[jira] [Resolved] (SPARK-9335) Kinesis test hits rate limit

2015-07-30 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9335. -- Resolution: Fixed Fix Version/s: 1.5.0 Kinesis test hits rate limit

[jira] [Commented] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

2015-07-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647313#comment-14647313 ] Jeff Zhang commented on SPARK-8167: --- [~mcheah] What's the status of this ticket ? I

[jira] [Created] (SPARK-9470) Java API function interface cleanup

2015-07-30 Thread Rahul Kavale (JIRA)
Rahul Kavale created SPARK-9470: --- Summary: Java API function interface cleanup Key: SPARK-9470 URL: https://issues.apache.org/jira/browse/SPARK-9470 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-6873) Some Hive-Catalyst comparison tests fail due to unimportant order of some printed elements

2015-07-30 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647322#comment-14647322 ] Pete Robbins commented on SPARK-6873: - We've been trying to get a clean build/test

[jira] [Commented] (SPARK-9408) Refactor mllib/linalg.py to mllib/linalg

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647862#comment-14647862 ] Xiangrui Meng commented on SPARK-9408: -- If we want to have distributed matrix API in

[jira] [Commented] (SPARK-7583) User guide update for RegexTokenizer

2015-07-30 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647904#comment-14647904 ] yuhao yang commented on SPARK-7583: --- I'd like to take a try if this is still needed.

[jira] [Resolved] (SPARK-9277) SparseVector constructor must throw an error when declared number of elements less than array length

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9277. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7794

[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

2015-07-30 Thread Jeremy Freeman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647884#comment-14647884 ] Jeremy Freeman commented on SPARK-9461: --- Interesting, the lack of failures on KMeans

[jira] [Commented] (SPARK-6227) PCA and SVD for PySpark

2015-07-30 Thread K S Sreenivasa Raghavan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647893#comment-14647893 ] K S Sreenivasa Raghavan commented on SPARK-6227: Hi, I have worked with

[jira] [Resolved] (SPARK-2089) With YARN, preferredNodeLocalityData isn't honored

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2089. -- Resolution: Won't Fix With YARN, preferredNodeLocalityData isn't honored

[jira] [Resolved] (SPARK-8175) date/time function: from_unixtime

2015-07-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8175. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7644

[jira] [Resolved] (SPARK-8174) date/time function: unix_timestamp

2015-07-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8174. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7644

[jira] [Commented] (SPARK-4449) specify port range in spark

2015-07-30 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648090#comment-14648090 ] Neelesh Srinivas Salian commented on SPARK-4449: I would like to pick this

[jira] [Assigned] (SPARK-9231) DistributedLDAModel method for top topics per document

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9231: --- Assignee: Apache Spark DistributedLDAModel method for top topics per document

[jira] [Assigned] (SPARK-9231) DistributedLDAModel method for top topics per document

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9231: --- Assignee: (was: Apache Spark) DistributedLDAModel method for top topics per document

[jira] [Resolved] (SPARK-9428) Add test cases for null inputs for expression unit tests

2015-07-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9428. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7748

[jira] [Comment Edited] (SPARK-8786) Create a wrapper for BinaryType

2015-07-30 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647248#comment-14647248 ] Takeshi Yamamuro edited comment on SPARK-8786 at 7/30/15 6:28 AM:

[jira] [Assigned] (SPARK-9464) Add property-based tests for UTF8String

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9464: --- Assignee: Apache Spark Add property-based tests for UTF8String

[jira] [Updated] (SPARK-9464) Add property-based tests for UTF8String

2015-07-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9464: -- Assignee: (was: Josh Rosen) Add property-based tests for UTF8String

[jira] [Assigned] (SPARK-9464) Add property-based tests for UTF8String

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9464: --- Assignee: (was: Apache Spark) Add property-based tests for UTF8String

[jira] [Commented] (SPARK-9464) Add property-based tests for UTF8String

2015-07-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647252#comment-14647252 ] Josh Rosen commented on SPARK-9464: --- Unassigning this myself since I don't have time to

[jira] [Updated] (SPARK-9464) Add property-based tests for UTF8String

2015-07-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9464: -- Target Version/s: 1.5.0 Priority: Critical (was: Major) Add property-based tests for

[jira] [Commented] (SPARK-7264) SparkR API for parallel functions

2015-07-30 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647268#comment-14647268 ] Rick Moritz commented on SPARK-7264: I've also added a bit of commentary. SparkR API

[jira] [Commented] (SPARK-9231) DistributedLDAModel method for top topics per document

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647233#comment-14647233 ] Apache Spark commented on SPARK-9231: - User 'hhbyyh' has created a pull request for

[jira] [Resolved] (SPARK-8005) Support INPUT__FILE__NAME virtual column

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8005. Resolution: Fixed Assignee: Joseph Batchik Fix Version/s: 1.5.0 Support

[jira] [Resolved] (SPARK-8007) Support resolving virtual columns in DataFrames

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8007. Resolution: Won't Fix These are now just functions. Support resolving virtual columns in

[jira] [Commented] (SPARK-9396) Spark yarn allocator does not call removeContainerRequest for allocated Container requests, resulting in bloated ask[] toYarn RM.

2015-07-30 Thread prakhar jauhari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647258#comment-14647258 ] prakhar jauhari commented on SPARK-9396: Can you please assign this issue to me, I

[jira] [Resolved] (SPARK-8002) Support virtual columns in SQL and DataFrames

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8002. Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 1.5.0 We ended up just

[jira] [Commented] (SPARK-6319) DISTINCT doesn't work for binary type

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647289#comment-14647289 ] Apache Spark commented on SPARK-6319: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-6319) DISTINCT doesn't work for binary type

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6319: --- Assignee: (was: Apache Spark) DISTINCT doesn't work for binary type

[jira] [Assigned] (SPARK-6319) DISTINCT doesn't work for binary type

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6319: --- Assignee: Apache Spark DISTINCT doesn't work for binary type

[jira] [Assigned] (SPARK-9239) HiveUDAF support for AggregateFunction2

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9239: --- Assignee: Apache Spark HiveUDAF support for AggregateFunction2

[jira] [Assigned] (SPARK-9239) HiveUDAF support for AggregateFunction2

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9239: --- Assignee: (was: Apache Spark) HiveUDAF support for AggregateFunction2

[jira] [Commented] (SPARK-9239) HiveUDAF support for AggregateFunction2

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647291#comment-14647291 ] Apache Spark commented on SPARK-9239: - User 'chenghao-intel' has created a pull

[jira] [Commented] (SPARK-9477) Adding IBM Platform Application Service Controller into Spark documentation as a supported Cluster Manager (beside Yarn and Mesos).

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647848#comment-14647848 ] Sean Owen commented on SPARK-9477: -- It's not part of Spark or supported by the project;

[jira] [Updated] (SPARK-9277) SparseVector constructor must throw an error when declared number of elements less than array length

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9277: - Assignee: Sean Owen SparseVector constructor must throw an error when declared number of

[jira] [Updated] (SPARK-9248) Closing curly-braces should always be on their own line

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9248: - Assignee: Yu Ishikawa Closing curly-braces should always be on their own line

[jira] [Resolved] (SPARK-9248) Closing curly-braces should always be on their own line

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9248. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Commented] (SPARK-9477) Adding IBM Platform Application Service Controller into Spark documentation as a supported Cluster Manager (beside Yarn and Mesos).

2015-07-30 Thread Stacy Pedersen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647886#comment-14647886 ] Stacy Pedersen commented on SPARK-9477: --- Fair enough, how about a link at the bottom

[jira] [Commented] (SPARK-9477) Adding IBM Platform Application Service Controller into Spark documentation as a supported Cluster Manager (beside Yarn and Mesos).

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647910#comment-14647910 ] Sean Owen commented on SPARK-9477: -- Seems reasonable to me -- anybody else have an

[jira] [Resolved] (SPARK-9225) LDASuite needs unit tests for empty documents

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9225. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7620

[jira] [Created] (SPARK-9480) Create an map abstract class MapData and a default implementation backed by 2 ArrayData

2015-07-30 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-9480: -- Summary: Create an map abstract class MapData and a default implementation backed by 2 ArrayData Key: SPARK-9480 URL: https://issues.apache.org/jira/browse/SPARK-9480

[jira] [Assigned] (SPARK-9480) Create an map abstract class MapData and a default implementation backed by 2 ArrayData

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9480: --- Assignee: (was: Apache Spark) Create an map abstract class MapData and a default

[jira] [Commented] (SPARK-9480) Create an map abstract class MapData and a default implementation backed by 2 ArrayData

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647888#comment-14647888 ] Apache Spark commented on SPARK-9480: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-9480) Create an map abstract class MapData and a default implementation backed by 2 ArrayData

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9480: --- Assignee: Apache Spark Create an map abstract class MapData and a default implementation

[jira] [Commented] (SPARK-9077) Improve error message for decision trees when numExamples maxCategoriesPerFeature

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647937#comment-14647937 ] Apache Spark commented on SPARK-9077: - User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-9077) Improve error message for decision trees when numExamples maxCategoriesPerFeature

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9077: --- Assignee: (was: Apache Spark) Improve error message for decision trees when numExamples

[jira] [Assigned] (SPARK-9077) Improve error message for decision trees when numExamples maxCategoriesPerFeature

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9077: --- Assignee: Apache Spark Improve error message for decision trees when numExamples

[jira] [Resolved] (SPARK-9390) Create an array abstract class ArrayData and a default implementation backed by Array[Object]

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9390. Resolution: Fixed Fix Version/s: 1.5.0 Create an array abstract class ArrayData and a

[jira] [Resolved] (SPARK-9267) Remove highly unnecessary accumulators stringify methods

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9267. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7678

[jira] [Updated] (SPARK-9267) Remove highly unnecessary accumulators stringify methods

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9267: - Assignee: François Garillot Remove highly unnecessary accumulators stringify methods

[jira] [Updated] (SPARK-6486) Add BlockMatrix in PySpark

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6486: - Assignee: Mike Dusenberry Add BlockMatrix in PySpark --

[jira] [Created] (SPARK-9489) Remove compatibleWith, meetsRequirements, and needsAnySort checks from Exchange

2015-07-30 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-9489: - Summary: Remove compatibleWith, meetsRequirements, and needsAnySort checks from Exchange Key: SPARK-9489 URL: https://issues.apache.org/jira/browse/SPARK-9489 Project:

[jira] [Created] (SPARK-9493) Chain logistic regression with isotonic regression under the pipeline API

2015-07-30 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9493: Summary: Chain logistic regression with isotonic regression under the pipeline API Key: SPARK-9493 URL: https://issues.apache.org/jira/browse/SPARK-9493 Project:

[jira] [Resolved] (SPARK-9408) Refactor mllib/linalg.py to mllib/linalg

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9408. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7746

[jira] [Updated] (SPARK-9361) Refactor new aggregation code to reduce the times of checking compatibility

2015-07-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9361: Issue Type: Sub-task (was: Improvement) Parent: SPARK-4366 Refactor new aggregation code to

[jira] [Resolved] (SPARK-9361) Refactor new aggregation code to reduce the times of checking compatibility

2015-07-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9361. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7677

[jira] [Updated] (SPARK-9361) Refactor new aggregation code to reduce the times of checking compatibility

2015-07-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9361: Assignee: Liang-Chi Hsieh Refactor new aggregation code to reduce the times of checking compatibility

[jira] [Resolved] (SPARK-8297) Scheduler backend is not notified in case node fails in YARN

2015-07-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-8297. --- Resolution: Fixed Fix Version/s: 1.5.0 Scheduler backend is not notified in case node

[jira] [Resolved] (SPARK-9388) Make log messages in ExecutorRunnable more readable

2015-07-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-9388. --- Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.5.0 Make log

[jira] [Commented] (SPARK-9437) SizeEstimator overflows for primitive arrays

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648025#comment-14648025 ] Shivaram Venkataraman commented on SPARK-9437: -- Resolved by

[jira] [Resolved] (SPARK-9437) SizeEstimator overflows for primitive arrays

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9437. -- Resolution: Fixed Fix Version/s: 1.5.0 SizeEstimator overflows for

[jira] [Assigned] (SPARK-9481) LocalLDAModel logLikelihood

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9481: --- Assignee: (was: Apache Spark) LocalLDAModel logLikelihood ---

[jira] [Updated] (SPARK-9481) LocalLDAModel logLikelihood

2015-07-30 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9481: - Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-5572) LocalLDAModel

[jira] [Commented] (SPARK-9481) LocalLDAModel logLikelihood

2015-07-30 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647991#comment-14647991 ] Feynman Liang commented on SPARK-9481: -- Working on this LocalLDAModel logLikelihood

[jira] [Created] (SPARK-9481) LocalLDAModel logLikelihood

2015-07-30 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9481: Summary: LocalLDAModel logLikelihood Key: SPARK-9481 URL: https://issues.apache.org/jira/browse/SPARK-9481 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-8850) Turn unsafe mode on by default

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8850. Resolution: Fixed Fix Version/s: 1.5.0 Turn unsafe mode on by default

[jira] [Commented] (SPARK-9481) LocalLDAModel logLikelihood

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648039#comment-14648039 ] Apache Spark commented on SPARK-9481: - User 'feynmanliang' has created a pull request

[jira] [Assigned] (SPARK-9481) LocalLDAModel logLikelihood

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9481: --- Assignee: Apache Spark LocalLDAModel logLikelihood ---

[jira] [Reopened] (SPARK-9282) Filter on Spark DataFrame with multiple columns

2015-07-30 Thread Sandeep Pal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Pal reopened SPARK-9282: On using '' instead of 'and', the following error occurs: Py4JError

[jira] [Commented] (SPARK-8497) Graph Clique(Complete Connected Sub-graph) Discovery Algorithm

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648126#comment-14648126 ] Xiangrui Meng commented on SPARK-8497: -- Please provide the algorithm you want to

[jira] [Updated] (SPARK-9463) Expose model coefficients with names in SparkR RFormula

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9463: - Assignee: Eric Liang Expose model coefficients with names in SparkR RFormula

[jira] [Created] (SPARK-9483) UTF8String.getPrefix only works in little-endian order

2015-07-30 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9483: -- Summary: UTF8String.getPrefix only works in little-endian order Key: SPARK-9483 URL: https://issues.apache.org/jira/browse/SPARK-9483 Project: Spark Issue Type:

[jira] [Updated] (SPARK-6805) MLlib + SparkR integration for 1.5

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6805: - Summary: MLlib + SparkR integration for 1.5 (was: ML Pipeline API in SparkR) MLlib + SparkR

[jira] [Updated] (SPARK-6805) MLlib + SparkR integration for 1.5

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6805: - Assignee: Eric Liang MLlib + SparkR integration for 1.5 --

[jira] [Updated] (SPARK-9463) Expose model coefficients with names in SparkR RFormula

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9463: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-6805 Expose model coefficients

[jira] [Updated] (SPARK-6805) MLlib + SparkR integration for 1.5

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6805: - Description: --SparkR was merged. So let's have this umbrella JIRA for the ML pipeline API in

[jira] [Created] (SPARK-9471) Multilayer perceptron

2015-07-30 Thread Alexander Ulanov (JIRA)
Alexander Ulanov created SPARK-9471: --- Summary: Multilayer perceptron Key: SPARK-9471 URL: https://issues.apache.org/jira/browse/SPARK-9471 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-9471) Multilayer perceptron

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9471: --- Assignee: Apache Spark Multilayer perceptron --

[jira] [Commented] (SPARK-9471) Multilayer perceptron

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647438#comment-14647438 ] Apache Spark commented on SPARK-9471: - User 'avulanov' has created a pull request for

[jira] [Assigned] (SPARK-9471) Multilayer perceptron

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9471: --- Assignee: (was: Apache Spark) Multilayer perceptron --

[jira] [Commented] (SPARK-8622) Spark 1.3.1 and 1.4.0 doesn't put executor working directory on executor classpath

2015-07-30 Thread Baswaraj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647440#comment-14647440 ] Baswaraj commented on SPARK-8622: - Any update on this ? Spark 1.3.1 and 1.4.0 doesn't

[jira] [Commented] (SPARK-3644) REST API for Spark application info (jobs / stages / tasks / storage info)

2015-07-30 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647441#comment-14647441 ] Imran Rashid commented on SPARK-3644: - [~zxzxy1988] The test is here

[jira] [Commented] (SPARK-9470) Java API function interface cleanup

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647443#comment-14647443 ] Sean Owen commented on SPARK-9470: -- I feel pretty strongly this is not worth it. I'd like

[jira] [Commented] (SPARK-4492) Exception when following SimpleApp tutorial java.lang.ClassNotFoundException: org.apache.spark.deploy.yarn.YarnSparkHadoopUtil

2015-07-30 Thread sam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647446#comment-14647446 ] sam commented on SPARK-4492: I imagine building a fat jar for running with `java -cp` is

[jira] [Comment Edited] (SPARK-9470) Java API function interface cleanup

2015-07-30 Thread Rahul Kavale (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647457#comment-14647457 ] Rahul Kavale edited comment on SPARK-9470 at 7/30/15 10:49 AM:

[jira] [Commented] (SPARK-9470) Java API function interface cleanup

2015-07-30 Thread Rahul Kavale (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647457#comment-14647457 ] Rahul Kavale commented on SPARK-9470: - Hi Sean, I just wanted to do this small cleanup

[jira] [Commented] (SPARK-9470) Java API function interface cleanup

2015-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647473#comment-14647473 ] Sean Owen commented on SPARK-9470: -- [~rahulkavale] see my comment on the PR. I also

[jira] [Assigned] (SPARK-9359) Support IntervalType for Parquet

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9359: --- Assignee: Apache Spark Support IntervalType for Parquet

[jira] [Commented] (SPARK-9359) Support IntervalType for Parquet

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647479#comment-14647479 ] Apache Spark commented on SPARK-9359: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-9359) Support IntervalType for Parquet

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9359: --- Assignee: (was: Apache Spark) Support IntervalType for Parquet

[jira] [Commented] (SPARK-7481) Add Hadoop 2.6+ profile to pull in object store FS accessors

2015-07-30 Thread Thomas Demoor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647406#comment-14647406 ] Thomas Demoor commented on SPARK-7481: -- Pulled the aws-upgrade out of HADOOP-11684 to

[jira] [Resolved] (SPARK-8838) Add config to enable/disable merging part-files when merging parquet schema

2015-07-30 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-8838. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7238

[jira] [Commented] (SPARK-5692) Model import/export for Word2Vec

2015-07-30 Thread Robin East (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647432#comment-14647432 ] Robin East commented on SPARK-5692: --- Hi the description includes the sentence 'We may

[jira] [Commented] (SPARK-9277) SparseVector constructor must throw an error when declared number of elements less than array length

2015-07-30 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647380#comment-14647380 ] Manoj Kumar commented on SPARK-9277: I will not have access to a development

[jira] [Commented] (SPARK-9470) Java API function interface cleanup

2015-07-30 Thread Rahul Kavale (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647487#comment-14647487 ] Rahul Kavale commented on SPARK-9470: - [~srowen] I see your point, just felt if we all

[jira] [Closed] (SPARK-9470) Java API function interface cleanup

2015-07-30 Thread Rahul Kavale (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rahul Kavale closed SPARK-9470. --- Resolution: Won't Fix Java API function interface cleanup ---

[jira] [Assigned] (SPARK-9277) SparseVector constructor must throw an error when declared number of elements less than array length

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9277: --- Assignee: Apache Spark SparseVector constructor must throw an error when declared number of

[jira] [Commented] (SPARK-9277) SparseVector constructor must throw an error when declared number of elements less than array length

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647490#comment-14647490 ] Apache Spark commented on SPARK-9277: - User 'srowen' has created a pull request for

<    1   2   3   4   >