[jira] [Created] (SPARK-9879) OOM in CTAS with LIMIT

2015-08-12 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-9879: Summary: OOM in CTAS with LIMIT Key: SPARK-9879 URL: https://issues.apache.org/jira/browse/SPARK-9879 Project: Spark Issue Type: Bug Components: SQL

[jira] [Commented] (SPARK-9793) PySpark DenseVector, SparseVector should override __eq__

2015-08-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693594#comment-14693594 ] Yanbo Liang commented on SPARK-9793: [~josephkb] I think we can override the

[jira] [Updated] (SPARK-9879) OOM in LIMIT clause with large number

2015-08-12 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-9879: - Summary: OOM in LIMIT clause with large number (was: OOM in CTAS with LIMIT) OOM in LIMIT clause with

[jira] [Commented] (SPARK-9662) ML 1.5 QA: API: Python API coverage

2015-08-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693641#comment-14693641 ] Yanbo Liang commented on SPARK-9662: [~josephkb] Checking for inconsistency and

[jira] [Updated] (SPARK-8644) SparkException thrown due to Executor exceptions should include caller site in stack trace

2015-08-12 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-8644: Fix Version/s: 1.5.0 SparkException thrown due to Executor exceptions should include caller site

[jira] [Resolved] (SPARK-8644) SparkException thrown due to Executor exceptions should include caller site in stack trace

2015-08-12 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-8644. - Resolution: Fixed SparkException thrown due to Executor exceptions should include caller site

[jira] [Updated] (SPARK-8625) Propagate user exceptions in tasks back to driver

2015-08-12 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-8625: Assignee: Tom White Propagate user exceptions in tasks back to driver

[jira] [Resolved] (SPARK-8625) Propagate user exceptions in tasks back to driver

2015-08-12 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-8625. - Resolution: Fixed Fix Version/s: 1.5.0 Propagate user exceptions in tasks back to driver

[jira] [Commented] (SPARK-9844) File appender race condition during SparkWorker shutdown

2015-08-12 Thread Alex Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693666#comment-14693666 ] Alex Liu commented on SPARK-9844: - Please provide a pull for it if you could File

[jira] [Commented] (SPARK-6795) Avoid reading Parquet footers on driver side when an global arbitrative schema is available

2015-08-12 Thread Olivier Toupin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693670#comment-14693670 ] Olivier Toupin commented on SPARK-6795: --- This doesn't seem to be fixed. I built the

[jira] [Created] (SPARK-9880) Make SparkConf accessible to KryoRegistrator

2015-08-12 Thread Robert Farr (JIRA)
Robert Farr created SPARK-9880: -- Summary: Make SparkConf accessible to KryoRegistrator Key: SPARK-9880 URL: https://issues.apache.org/jira/browse/SPARK-9880 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9879) OOM in CTAS with LIMIT

2015-08-12 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-9879: - Description: {code} create table spark.tablsetest as select * from dpa_ord_bill_tf order by member_id

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-08-12 Thread Jason Dai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693579#comment-14693579 ] Jason Dai commented on SPARK-5556: -- Sure; we can share our code on github, and then try

[jira] [Assigned] (SPARK-9879) OOM in CTAS with LIMIT

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9879: --- Assignee: (was: Apache Spark) OOM in CTAS with LIMIT --

[jira] [Commented] (SPARK-9879) OOM in CTAS with LIMIT

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693591#comment-14693591 ] Apache Spark commented on SPARK-9879: - User 'chenghao-intel' has created a pull

[jira] [Assigned] (SPARK-9879) OOM in CTAS with LIMIT

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9879: --- Assignee: Apache Spark OOM in CTAS with LIMIT --

[jira] [Created] (SPARK-9881) Support additional KryoRegistrators via an SPI lookup

2015-08-12 Thread Robert Farr (JIRA)
Robert Farr created SPARK-9881: -- Summary: Support additional KryoRegistrators via an SPI lookup Key: SPARK-9881 URL: https://issues.apache.org/jira/browse/SPARK-9881 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-9907) Python crc32 is mistakenly calling md5

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9907: --- Assignee: Reynold Xin (was: Apache Spark) Python crc32 is mistakenly calling md5

[jira] [Commented] (SPARK-9915) StopWordsRemover.stopWords should use StringArrayParam

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694304#comment-14694304 ] Apache Spark commented on SPARK-9915: - User 'mengxr' has created a pull request for

[jira] [Assigned] (SPARK-9915) StopWordsRemover.stopWords should use StringArrayParam

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9915: --- Assignee: Xiangrui Meng (was: Apache Spark) StopWordsRemover.stopWords should use

[jira] [Assigned] (SPARK-9915) StopWordsRemover.stopWords should use StringArrayParam

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9915: --- Assignee: Apache Spark (was: Xiangrui Meng) StopWordsRemover.stopWords should use

[jira] [Commented] (SPARK-9897) User Guide for Multilayer Perceptron Classifier

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694361#comment-14694361 ] Feynman Liang commented on SPARK-9897: -- Yep, thanks for pointing that out! User

[jira] [Closed] (SPARK-9897) User Guide for Multilayer Perceptron Classifier

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang closed SPARK-9897. Resolution: Duplicate User Guide for Multilayer Perceptron Classifier

[jira] [Assigned] (SPARK-9908) TPCDS Q98 failed when tungsten is off

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9908: --- Assignee: Yin Huai (was: Apache Spark) TPCDS Q98 failed when tungsten is off

[jira] [Commented] (SPARK-9908) TPCDS Q98 failed when tungsten is off

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694382#comment-14694382 ] Apache Spark commented on SPARK-9908: - User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-9920) The simpleString of TungstenAggregate does not show its output

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9920: --- Assignee: Apache Spark (was: Yin Huai) The simpleString of TungstenAggregate does not show

[jira] [Commented] (SPARK-9920) The simpleString of TungstenAggregate does not show its output

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694403#comment-14694403 ] Apache Spark commented on SPARK-9920: - User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-9920) The simpleString of TungstenAggregate does not show its output

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9920: --- Assignee: Yin Huai (was: Apache Spark) The simpleString of TungstenAggregate does not show

[jira] [Commented] (SPARK-7707) User guide and example code for Statistics.kernelDensity

2015-08-12 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694413#comment-14694413 ] Sandy Ryza commented on SPARK-7707: --- Again, sorry for the long delay here. I'm

[jira] [Commented] (SPARK-9922) Rename StringIndexerInverse to IndexToString

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694414#comment-14694414 ] Apache Spark commented on SPARK-9922: - User 'mengxr' has created a pull request for

[jira] [Assigned] (SPARK-9922) Rename StringIndexerInverse to IndexToString

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9922: --- Assignee: Apache Spark (was: Xiangrui Meng) Rename StringIndexerInverse to IndexToString

[jira] [Updated] (SPARK-9826) Cannot use custom classes in log4j.properties

2015-08-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-9826: -- Target Version/s: 1.4.2, 1.5.0 Labels: regression (was: ) Cannot use custom

[jira] [Commented] (SPARK-9924) checkForLogs and cleanLogs are scheduled at fixed rate and can get piled up

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694450#comment-14694450 ] Apache Spark commented on SPARK-9924: - User 'mindprince' has created a pull request

[jira] [Assigned] (SPARK-9924) checkForLogs and cleanLogs are scheduled at fixed rate and can get piled up

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9924: --- Assignee: (was: Apache Spark) checkForLogs and cleanLogs are scheduled at fixed rate

[jira] [Commented] (SPARK-9199) Upgrade Tachyon dependency to 0.7.0

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694093#comment-14694093 ] Apache Spark commented on SPARK-9199: - User 'calvinjia' has created a pull request for

[jira] [Created] (SPARK-9889) DCT User Guide

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9889: Summary: DCT User Guide Key: SPARK-9889 URL: https://issues.apache.org/jira/browse/SPARK-9889 Project: Spark Issue Type: Documentation Components:

[jira] [Updated] (SPARK-8670) Nested columns can't be referenced (but they can be selected)

2015-08-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8670: -- Priority: Critical (was: Major) Nested columns can't be referenced (but they can be selected)

[jira] [Updated] (SPARK-8670) Nested columns can't be referenced (but they can be selected)

2015-08-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8670: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-9564 Nested columns can't be referenced (but

[jira] [Updated] (SPARK-8670) Nested columns can't be referenced (but they can be selected)

2015-08-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8670: Target Version/s: 1.5.0 Priority: Blocker (was: Critical) Nested columns

[jira] [Created] (SPARK-9896) Parquet Schema Assertion

2015-08-12 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-9896: --- Summary: Parquet Schema Assertion Key: SPARK-9896 URL: https://issues.apache.org/jira/browse/SPARK-9896 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-9896) Parquet Schema Assertion

2015-08-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9896: Issue Type: Sub-task (was: Bug) Parent: SPARK-9565 Parquet Schema Assertion

[jira] [Created] (SPARK-9901) User guide for RowMatrix Tall-and-skinny QR

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9901: Summary: User guide for RowMatrix Tall-and-skinny QR Key: SPARK-9901 URL: https://issues.apache.org/jira/browse/SPARK-9901 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9903) Skip local processing in PrefixSpan if there are no small prefixes

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694195#comment-14694195 ] Apache Spark commented on SPARK-9903: - User 'mengxr' has created a pull request for

[jira] [Resolved] (SPARK-9896) Parquet Schema Assertion

2015-08-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9896. - Resolution: Cannot Reproduce Parquet Schema Assertion

[jira] [Commented] (SPARK-9897) User Guide for Multilayer Perceptron Classifier

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694279#comment-14694279 ] Feynman Liang commented on SPARK-9897: -- [~avulanov] do you have time for this? User

[jira] [Commented] (SPARK-9893) User guide for VectorSlicer

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694283#comment-14694283 ] Feynman Liang commented on SPARK-9893: -- [~yinxusen] do you have time for this? User

[jira] [Updated] (SPARK-9915) StopWordsRemover.stopWords should use StringArrayParam

2015-08-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9915: - Description: was:We only need specialized version for primitive types

[jira] [Commented] (SPARK-9895) User Guide for RFormula Feature Transformer

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694280#comment-14694280 ] Feynman Liang commented on SPARK-9895: -- [~ekhliang] do you have time for this? User

[jira] [Created] (SPARK-9915) StopWordsRemover.stopWords should use StringArrayParam

2015-08-12 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9915: Summary: StopWordsRemover.stopWords should use StringArrayParam Key: SPARK-9915 URL: https://issues.apache.org/jira/browse/SPARK-9915 Project: Spark Issue

[jira] [Commented] (SPARK-3655) Support sorting of values in addition to keys (i.e. secondary sort)

2015-08-12 Thread Koert Kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694302#comment-14694302 ] Koert Kuipers commented on SPARK-3655: -- it depends on the size of your values per

[jira] [Commented] (SPARK-9895) User Guide for RFormula Feature Transformer

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694372#comment-14694372 ] Feynman Liang commented on SPARK-9895: -- [~mengxr] please assign User Guide for

[jira] [Updated] (SPARK-9909) Move weightCol to sharedParams

2015-08-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9909: - Target Version/s: 1.5.0 Move weightCol to sharedParams --

[jira] [Resolved] (SPARK-9913) LDAUtils should be private

2015-08-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9913. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8142

[jira] [Resolved] (SPARK-9909) Move weightCol to sharedParams

2015-08-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9909. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8144

[jira] [Updated] (SPARK-9923) ShuffleMapStage.numAvailableOutputs should be an Int instead of Long

2015-08-12 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-9923: - Labels: Starter (was: ) ShuffleMapStage.numAvailableOutputs should be an Int instead of Long

[jira] [Resolved] (SPARK-9449) inputFiles misses files from MetastoreRelation

2015-08-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9449. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8119

[jira] [Created] (SPARK-9924) checkForLogs and cleanLogs are scheduled at fixed rate and can get piled up

2015-08-12 Thread Rohit Agarwal (JIRA)
Rohit Agarwal created SPARK-9924: Summary: checkForLogs and cleanLogs are scheduled at fixed rate and can get piled up Key: SPARK-9924 URL: https://issues.apache.org/jira/browse/SPARK-9924 Project:

[jira] [Updated] (SPARK-9883) Distance to each cluster given a point

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9883: - Affects Version/s: (was: 1.4.1) Distance to each cluster given a point

[jira] [Commented] (SPARK-9883) Distance to each cluster given a point

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694139#comment-14694139 ] Joseph K. Bradley commented on SPARK-9883: -- This seems like a nice thing to

[jira] [Updated] (SPARK-9888) Update LDA User Guide

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9888: - Description: LDA has received numerous updates in 1.5, including: * OnlineLDAOptimizer:

[jira] [Assigned] (SPARK-9903) Skip local processing in PrefixSpan if there are no small prefixes

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9903: --- Assignee: Apache Spark (was: Xiangrui Meng) Skip local processing in PrefixSpan if there

[jira] [Assigned] (SPARK-9903) Skip local processing in PrefixSpan if there are no small prefixes

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9903: --- Assignee: Xiangrui Meng (was: Apache Spark) Skip local processing in PrefixSpan if there

[jira] [Created] (SPARK-9904) User guide for ML tree algorithms

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9904: Summary: User guide for ML tree algorithms Key: SPARK-9904 URL: https://issues.apache.org/jira/browse/SPARK-9904 Project: Spark Issue Type: Documentation

[jira] [Created] (SPARK-9910) User guide for train validation split

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9910: Summary: User guide for train validation split Key: SPARK-9910 URL: https://issues.apache.org/jira/browse/SPARK-9910 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9902) User guide for 1-sample KS test

2015-08-12 Thread Jose Cambronero (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694301#comment-14694301 ] Jose Cambronero commented on SPARK-9902: [~fliang] Is this different from what is

[jira] [Assigned] (SPARK-9912) QRDecomposition should use QType and RType for type names instead of UType and VType

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9912: --- Assignee: Apache Spark (was: Xiangrui Meng) QRDecomposition should use QType and RType for

[jira] [Commented] (SPARK-9918) Remove runs from KMeans under the pipeline API

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694365#comment-14694365 ] Joseph K. Bradley commented on SPARK-9918: -- I like this idea. runs seems like it

[jira] [Resolved] (SPARK-9092) Make --num-executors compatible with dynamic allocation

2015-08-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-9092. --- Resolution: Fixed Fix Version/s: 1.5.0 Make --num-executors compatible with dynamic

[jira] [Created] (SPARK-9888) Update LDA User Guide

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9888: Summary: Update LDA User Guide Key: SPARK-9888 URL: https://issues.apache.org/jira/browse/SPARK-9888 Project: Spark Issue Type: Documentation

[jira] [Reopened] (SPARK-8670) Nested columns can't be referenced (but they can be selected)

2015-08-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-8670: --- Nested columns can't be referenced (but they can be selected)

[jira] [Updated] (SPARK-8670) Nested columns can't be referenced (but they can be selected)

2015-08-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8670: -- Affects Version/s: 1.5.0 1.4.1 Nested columns can't be referenced (but they can

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694123#comment-14694123 ] Joseph K. Bradley commented on SPARK-9660: -- We should mark as many JIRAs for 1.5

[jira] [Commented] (SPARK-8670) Nested columns can't be referenced (but they can be selected)

2015-08-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694133#comment-14694133 ] Josh Rosen commented on SPARK-8670: --- I've re-opened this for Spark 1.5.0 since this

[jira] [Closed] (SPARK-9863) weird output from optimizer limited-memory BFGS

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-9863. Resolution: Not A Problem You can see progress at the beginning, but later on, the digits

[jira] [Commented] (SPARK-7707) User guide and example code for Statistics.kernelDensity

2015-08-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694207#comment-14694207 ] Xiangrui Meng commented on SPARK-7707: -- [~sandyr] Do you have time to write the user

[jira] [Updated] (SPARK-9908) TPCDS Q98 failed when tungsten is off

2015-08-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-9908: -- Description: {code} org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage

[jira] [Commented] (SPARK-9907) Python crc32 is mistakenly calling md5

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694237#comment-14694237 ] Apache Spark commented on SPARK-9907: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-9907) Python crc32 is mistakenly calling md5

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9907: --- Assignee: Apache Spark (was: Reynold Xin) Python crc32 is mistakenly calling md5

[jira] [Updated] (SPARK-9900) User Guide for Association Rule Generation

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9900: - Summary: User Guide for Association Rule Generation (was: Association Rule Generation) User

[jira] [Closed] (SPARK-9892) User Guide for StopWordsRemover

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang closed SPARK-9892. Resolution: Duplicate Duplicate of SPARK-9680 User Guide for StopWordsRemover

[jira] [Created] (SPARK-9908) TPCDS Q98 failed when tungsten is off

2015-08-12 Thread Davies Liu (JIRA)
Davies Liu created SPARK-9908: - Summary: TPCDS Q98 failed when tungsten is off Key: SPARK-9908 URL: https://issues.apache.org/jira/browse/SPARK-9908 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-9913) LDAUtils should be private

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694307#comment-14694307 ] Apache Spark commented on SPARK-9913: - User 'mengxr' has created a pull request for

[jira] [Assigned] (SPARK-9913) LDAUtils should be private

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9913: --- Assignee: Xiangrui Meng (was: Apache Spark) LDAUtils should be private

[jira] [Assigned] (SPARK-9913) LDAUtils should be private

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9913: --- Assignee: Apache Spark (was: Xiangrui Meng) LDAUtils should be private

[jira] [Assigned] (SPARK-9843) Catalyst: Allow adding custom optimizers

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9843: --- Assignee: Apache Spark Catalyst: Allow adding custom optimizers

[jira] [Assigned] (SPARK-9843) Catalyst: Allow adding custom optimizers

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9843: --- Assignee: (was: Apache Spark) Catalyst: Allow adding custom optimizers

[jira] [Commented] (SPARK-9917) MinMaxScaler missing getters and docs

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694330#comment-14694330 ] Apache Spark commented on SPARK-9917: - User 'mengxr' has created a pull request for

[jira] [Commented] (SPARK-9843) Catalyst: Allow adding custom optimizers

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694331#comment-14694331 ] Apache Spark commented on SPARK-9843: - User 'robert3005' has created a pull request

[jira] [Assigned] (SPARK-9917) MinMaxScaler missing getters and docs

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9917: --- Assignee: Xiangrui Meng (was: Apache Spark) MinMaxScaler missing getters and docs

[jira] [Assigned] (SPARK-9917) MinMaxScaler missing getters and docs

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9917: --- Assignee: Apache Spark (was: Xiangrui Meng) MinMaxScaler missing getters and docs

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694342#comment-14694342 ] Feynman Liang commented on SPARK-9660: -- Makes sense, resolving this issue. ML 1.5

[jira] [Commented] (SPARK-9897) User Guide for Multilayer Perceptron Classifier

2015-08-12 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694356#comment-14694356 ] Alexander Ulanov commented on SPARK-9897: - We already have an issue for MLP

[jira] [Issue Comment Deleted] (SPARK-9897) User Guide for Multilayer Perceptron Classifier

2015-08-12 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Ulanov updated SPARK-9897: Comment: was deleted (was: We already have an issue for MLP classifier docs:

[jira] [Commented] (SPARK-9897) User Guide for Multilayer Perceptron Classifier

2015-08-12 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694355#comment-14694355 ] Alexander Ulanov commented on SPARK-9897: - We already have an issue for MLP

[jira] [Assigned] (SPARK-9922) Rename StringIndexerInverse to IndexToString

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9922: --- Assignee: Xiangrui Meng (was: Apache Spark) Rename StringIndexerInverse to IndexToString

[jira] [Created] (SPARK-9890) User guide for CountVectorizer

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9890: Summary: User guide for CountVectorizer Key: SPARK-9890 URL: https://issues.apache.org/jira/browse/SPARK-9890 Project: Spark Issue Type: Documentation

[jira] [Created] (SPARK-9892) User Guide for StopWordsRemover

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9892: Summary: User Guide for StopWordsRemover Key: SPARK-9892 URL: https://issues.apache.org/jira/browse/SPARK-9892 Project: Spark Issue Type: Documentation

[jira] [Created] (SPARK-9897) User Guide for Multilayer Perceptron Classifier

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9897: Summary: User Guide for Multilayer Perceptron Classifier Key: SPARK-9897 URL: https://issues.apache.org/jira/browse/SPARK-9897 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9900) Association Rule Generation

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9900: - Description: SPARK-8559 extends {{FPGrowth}} to allow for association rule generation. This

[jira] [Created] (SPARK-9903) Skip local processing in PrefixSpan if there are no small prefixes

2015-08-12 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9903: Summary: Skip local processing in PrefixSpan if there are no small prefixes Key: SPARK-9903 URL: https://issues.apache.org/jira/browse/SPARK-9903 Project: Spark

  1   2   3   4   5   >