[jira] [Created] (SPARK-9905) User guide for LinearRegressionSummary

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9905: Summary: User guide for LinearRegressionSummary Key: SPARK-9905 URL: https://issues.apache.org/jira/browse/SPARK-9905 Project: Spark Issue Type:

[jira] [Created] (SPARK-9906) User guide for LogisticRegressionSummary

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9906: Summary: User guide for LogisticRegressionSummary Key: SPARK-9906 URL: https://issues.apache.org/jira/browse/SPARK-9906 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9903) Skip local processing in PrefixSpan if there are no small prefixes

2015-08-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9903: - Shepherd: Feynman Liang Skip local processing in PrefixSpan if there are no small prefixes

[jira] [Closed] (SPARK-9904) User guide for ML tree algorithms

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang closed SPARK-9904. Resolution: Duplicate Duplicate of SPARK-7772 User guide for ML tree algorithms

[jira] [Commented] (SPARK-9889) DCT User Guide

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694286#comment-14694286 ] Feynman Liang commented on SPARK-9889: -- [~mengxr] please assign to me DCT User

[jira] [Closed] (SPARK-9891) User guide for MinMaxScaler

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang closed SPARK-9891. Resolution: Duplicate Duplicate of SPARK-8531 User guide for MinMaxScaler

[jira] [Created] (SPARK-9916) Clear leftover sparkr.zip copies and creations (e.g. make-distribution.sh)

2015-08-12 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-9916: -- Summary: Clear leftover sparkr.zip copies and creations (e.g. make-distribution.sh) Key: SPARK-9916 URL: https://issues.apache.org/jira/browse/SPARK-9916 Project: Spark

[jira] [Commented] (SPARK-9890) User guide for CountVectorizer

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694285#comment-14694285 ] Feynman Liang commented on SPARK-9890: -- [~yuhaoyan] do you have time for this? User

[jira] [Created] (SPARK-9917) MinMaxScaler missing getters and docs

2015-08-12 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9917: Summary: MinMaxScaler missing getters and docs Key: SPARK-9917 URL: https://issues.apache.org/jira/browse/SPARK-9917 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-9918) Remove runs from KMeans under the pipeline API

2015-08-12 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9918: Summary: Remove runs from KMeans under the pipeline API Key: SPARK-9918 URL: https://issues.apache.org/jira/browse/SPARK-9918 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9888) Update LDA User Guide

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694287#comment-14694287 ] Feynman Liang commented on SPARK-9888: -- [~mengxr] please assign to me Update LDA

[jira] [Commented] (SPARK-9902) User guide for 1-sample KS test

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694309#comment-14694309 ] Feynman Liang commented on SPARK-9902: -- Oops, sorry you're right; I totally missed

[jira] [Resolved] (SPARK-9907) Python crc32 is mistakenly calling md5

2015-08-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9907. Resolution: Fixed Fix Version/s: 1.5.0 Python crc32 is mistakenly calling md5

[jira] [Updated] (SPARK-9902) Add Java and Python examples to user guide for 1-sample KS test

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9902: - Summary: Add Java and Python examples to user guide for 1-sample KS test (was: User guide for

[jira] [Updated] (SPARK-9902) Add Java and Python examples to user guide for 1-sample KS test

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9902: - Description: SPARK-8598 adds 1-sample kolmogorov-smirnov tests, which needs * Java and python

[jira] [Assigned] (SPARK-9908) TPCDS Q98 failed when tungsten is off

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9908: --- Assignee: Apache Spark (was: Yin Huai) TPCDS Q98 failed when tungsten is off

[jira] [Updated] (SPARK-9909) Move weightCol to sharedParams

2015-08-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9909: - Assignee: holdenk Move weightCol to sharedParams --

[jira] [Updated] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

2015-08-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-7736: -- Target Version/s: 1.5.1 (was: 1.5.0) Exception not failing Python applications (in yarn

[jira] [Resolved] (SPARK-9912) QRDecomposition should use QType and RType for type names instead of UType and VType

2015-08-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9912. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8140

[jira] [Commented] (SPARK-9901) User guide for RowMatrix Tall-and-skinny QR

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694459#comment-14694459 ] Feynman Liang commented on SPARK-9901: -- [~mengxr] please assign User guide for

[jira] [Commented] (SPARK-9901) User guide for RowMatrix Tall-and-skinny QR

2015-08-12 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694458#comment-14694458 ] yuhao yang commented on SPARK-9901: --- Thanks for helping create the item. I'd like to

[jira] [Created] (SPARK-9925) Set SQLConf.SHUFFLE_PARTITIONS.key correctly for tests

2015-08-12 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9925: --- Summary: Set SQLConf.SHUFFLE_PARTITIONS.key correctly for tests Key: SPARK-9925 URL: https://issues.apache.org/jira/browse/SPARK-9925 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-9826) Cannot use custom classes in log4j.properties

2015-08-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-9826. --- Resolution: Fixed Fix Version/s: 1.5.0 1.4.2 Cannot use custom

[jira] [Created] (SPARK-9891) User guide for MinMaxScaler

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9891: Summary: User guide for MinMaxScaler Key: SPARK-9891 URL: https://issues.apache.org/jira/browse/SPARK-9891 Project: Spark Issue Type: Documentation

[jira] [Created] (SPARK-9895) User Guide for RFormula Feature Transformer

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9895: Summary: User Guide for RFormula Feature Transformer Key: SPARK-9895 URL: https://issues.apache.org/jira/browse/SPARK-9895 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9906) User guide for LogisticRegressionSummary

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694271#comment-14694271 ] Feynman Liang commented on SPARK-9906: -- [~MechCoder] do you have time for this?

[jira] [Commented] (SPARK-9902) User guide for 1-sample KS test

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694274#comment-14694274 ] Feynman Liang commented on SPARK-9902: -- [~josepablocam] do you have time for this?

[jira] [Commented] (SPARK-9898) User guide for PrefixSpan

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694277#comment-14694277 ] Feynman Liang commented on SPARK-9898: -- [~mengxr] please assign to me User guide

[jira] [Commented] (SPARK-9901) User guide for RowMatrix Tall-and-skinny QR

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694275#comment-14694275 ] Feynman Liang commented on SPARK-9901: -- [~yuhaoyan] do you have time for this? User

[jira] [Commented] (SPARK-9900) User Guide for Association Rule Generation

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694276#comment-14694276 ] Feynman Liang commented on SPARK-9900: -- [~mengxr] please assign to me User Guide

[jira] [Commented] (SPARK-9905) User guide for LinearRegressionSummary

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694272#comment-14694272 ] Feynman Liang commented on SPARK-9905: -- [~mengxr] please assign to me. User guide

[jira] [Created] (SPARK-9914) RFormula are missing setters for featuresCol and labelCol

2015-08-12 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9914: Summary: RFormula are missing setters for featuresCol and labelCol Key: SPARK-9914 URL: https://issues.apache.org/jira/browse/SPARK-9914 Project: Spark

[jira] [Assigned] (SPARK-9914) RFormula are missing setters for featuresCol and labelCol

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9914: --- Assignee: Apache Spark (was: Xiangrui Meng) RFormula are missing setters for featuresCol

[jira] [Commented] (SPARK-9914) RFormula are missing setters for featuresCol and labelCol

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694315#comment-14694315 ] Apache Spark commented on SPARK-9914: - User 'mengxr' has created a pull request for

[jira] [Assigned] (SPARK-9914) RFormula are missing setters for featuresCol and labelCol

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9914: --- Assignee: Xiangrui Meng (was: Apache Spark) RFormula are missing setters for featuresCol

[jira] [Assigned] (SPARK-9909) Move weightCol to sharedParams

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9909: --- Assignee: Apache Spark Move weightCol to sharedParams --

[jira] [Updated] (SPARK-9902) Add Java and Python examples to user guide for 1-sample KS test

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9902: - Description: SPARK-8598 adds 1-sample kolmogorov-smirnov tests, which needs Java and python code

[jira] [Commented] (SPARK-9895) User Guide for RFormula Feature Transformer

2015-08-12 Thread Eric Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694371#comment-14694371 ] Eric Liang commented on SPARK-9895: --- Sure, I can take this task. User Guide for

[jira] [Resolved] (SPARK-9707) Test sort-based fallback mode for dynamic partition insert

2015-08-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9707. - Resolution: Fixed I ran a test using a medium sized table in TPCDS SF=1500 both with a

[jira] [Updated] (SPARK-6280) Remove Akka systemName from Spark

2015-08-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-6280: -- Target Version/s: 1.6.0 (was: 1.5.0) Remove Akka systemName from Spark

[jira] [Updated] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

2015-08-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-8167: -- Target Version/s: (was: 1.5.0) Fix Version/s: 1.6.0 Sorry, reviewing your PR is on my

[jira] [Assigned] (SPARK-9924) checkForLogs and cleanLogs are scheduled at fixed rate and can get piled up

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9924: --- Assignee: Apache Spark checkForLogs and cleanLogs are scheduled at fixed rate and can get

[jira] [Reopened] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang reopened SPARK-9660: -- Reopening since there are related issues about missing documentation which have not yet been

[jira] [Commented] (SPARK-9880) Make SparkConf accessible to KryoRegistrator

2015-08-12 Thread Robert Farr (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694163#comment-14694163 ] Robert Farr commented on SPARK-9880: After some more investigation one option would be

[jira] [Created] (SPARK-9900) Association Rule Generation

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9900: Summary: Association Rule Generation Key: SPARK-9900 URL: https://issues.apache.org/jira/browse/SPARK-9900 Project: Spark Issue Type: Documentation

[jira] [Resolved] (SPARK-8967) Implement @since as an annotation

2015-08-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8967. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8131

[jira] [Created] (SPARK-9907) Python crc32 is mistakenly calling md5

2015-08-12 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9907: -- Summary: Python crc32 is mistakenly calling md5 Key: SPARK-9907 URL: https://issues.apache.org/jira/browse/SPARK-9907 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-9911) User doc for MulticlassClassificationEvaluator

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9911: Summary: User doc for MulticlassClassificationEvaluator Key: SPARK-9911 URL: https://issues.apache.org/jira/browse/SPARK-9911 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-9912) QRDecomposition should use QType and RType for type names instead of UType and VType

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9912: --- Assignee: Xiangrui Meng (was: Apache Spark) QRDecomposition should use QType and RType for

[jira] [Commented] (SPARK-9912) QRDecomposition should use QType and RType for type names instead of UType and VType

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694295#comment-14694295 ] Apache Spark commented on SPARK-9912: - User 'mengxr' has created a pull request for

[jira] [Created] (SPARK-9921) Too many open files in Spark SQL

2015-08-12 Thread Antonio Piccolboni (JIRA)
Antonio Piccolboni created SPARK-9921: - Summary: Too many open files in Spark SQL Key: SPARK-9921 URL: https://issues.apache.org/jira/browse/SPARK-9921 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-9920) The simpleString of TungstenAggregate does not show its output

2015-08-12 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9920: --- Summary: The simpleString of TungstenAggregate does not show its output Key: SPARK-9920 URL: https://issues.apache.org/jira/browse/SPARK-9920 Project: Spark Issue

[jira] [Created] (SPARK-9923) ShuffleMapStage.numAvailableOutputs should be an Int instead of Long

2015-08-12 Thread Matei Zaharia (JIRA)
Matei Zaharia created SPARK-9923: Summary: ShuffleMapStage.numAvailableOutputs should be an Int instead of Long Key: SPARK-9923 URL: https://issues.apache.org/jira/browse/SPARK-9923 Project: Spark

[jira] [Resolved] (SPARK-9766) check and add missing docs for PySpark ML

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9766. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8059

[jira] [Updated] (SPARK-9894) Writing of JSON files with MapType is broken

2015-08-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9894: Description: {code} Caused by: scala.MatchError: (MapType(StringType,StringType,true),keys:

[jira] [Created] (SPARK-9894) Writing of JSON files with MapType is broken

2015-08-12 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-9894: --- Summary: Writing of JSON files with MapType is broken Key: SPARK-9894 URL: https://issues.apache.org/jira/browse/SPARK-9894 Project: Spark Issue Type:

[jira] [Created] (SPARK-9899) JSON writing retry broken with direct output committer

2015-08-12 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-9899: --- Summary: JSON writing retry broken with direct output committer Key: SPARK-9899 URL: https://issues.apache.org/jira/browse/SPARK-9899 Project: Spark

[jira] [Updated] (SPARK-9897) User Guide for Multilayer Perceptron Classifier

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9897: - Issue Type: Documentation (was: Umbrella) User Guide for Multilayer Perceptron Classifier

[jira] [Created] (SPARK-9898) User guide for PrefixSpan

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9898: Summary: User guide for PrefixSpan Key: SPARK-9898 URL: https://issues.apache.org/jira/browse/SPARK-9898 Project: Spark Issue Type: Documentation

[jira] [Resolved] (SPARK-9789) Reinstate LogisticRegression threshold Param

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9789. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8079

[jira] [Assigned] (SPARK-9894) Writing of JSON files with MapType is broken

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9894: --- Assignee: Apache Spark (was: Yin Huai) Writing of JSON files with MapType is broken

[jira] [Commented] (SPARK-9894) Writing of JSON files with MapType is broken

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694222#comment-14694222 ] Apache Spark commented on SPARK-9894: - User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-9894) Writing of JSON files with MapType is broken

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9894: --- Assignee: Yin Huai (was: Apache Spark) Writing of JSON files with MapType is broken

[jira] [Created] (SPARK-9913) LDAUtils should be private

2015-08-12 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9913: Summary: LDAUtils should be private Key: SPARK-9913 URL: https://issues.apache.org/jira/browse/SPARK-9913 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-9912) QRDecomposition should use QType and RType for type names instead of UType and VType

2015-08-12 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9912: Summary: QRDecomposition should use QType and RType for type names instead of UType and VType Key: SPARK-9912 URL: https://issues.apache.org/jira/browse/SPARK-9912

[jira] [Updated] (SPARK-9911) User guide for MulticlassClassificationEvaluator

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9911: - Summary: User guide for MulticlassClassificationEvaluator (was: User doc for

[jira] [Commented] (SPARK-9909) Move weightCol to sharedParams

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694317#comment-14694317 ] Apache Spark commented on SPARK-9909: - User 'holdenk' has created a pull request for

[jira] [Assigned] (SPARK-9909) Move weightCol to sharedParams

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9909: --- Assignee: (was: Apache Spark) Move weightCol to sharedParams

[jira] [Commented] (SPARK-9916) Clear leftover sparkr.zip copies and creations (e.g. make-distribution.sh)

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694337#comment-14694337 ] Apache Spark commented on SPARK-9916: - User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-9916) Clear leftover sparkr.zip copies and creations (e.g. make-distribution.sh)

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9916: --- Assignee: (was: Apache Spark) Clear leftover sparkr.zip copies and creations (e.g.

[jira] [Assigned] (SPARK-9916) Clear leftover sparkr.zip copies and creations (e.g. make-distribution.sh)

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9916: --- Assignee: Apache Spark Clear leftover sparkr.zip copies and creations (e.g.

[jira] [Resolved] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang resolved SPARK-9660. -- Resolution: Fixed ML 1.5 QA: API: New Scala APIs, docs

[jira] [Created] (SPARK-9922) Rename StringIndexerInverse to IndexToString

2015-08-12 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9922: Summary: Rename StringIndexerInverse to IndexToString Key: SPARK-9922 URL: https://issues.apache.org/jira/browse/SPARK-9922 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-9832) TPCDS Q98 Fails

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9832: --- Assignee: Davies Liu (was: Apache Spark) TPCDS Q98 Fails ---

[jira] [Commented] (SPARK-9832) TPCDS Q98 Fails

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694410#comment-14694410 ] Apache Spark commented on SPARK-9832: - User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-9832) TPCDS Q98 Fails

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9832: --- Assignee: Apache Spark (was: Davies Liu) TPCDS Q98 Fails ---

[jira] [Resolved] (SPARK-9894) Writing of JSON files with MapType is broken

2015-08-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9894. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8137

[jira] [Updated] (SPARK-8617) Handle history files better

2015-08-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-8617: -- Target Version/s: (was: 1.5.0) Handle history files better ---

[jira] [Commented] (SPARK-9887) After recent hive patches PySpark fails with IllegalArgumentException: Wrong FS: hdfs:

2015-08-12 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694092#comment-14694092 ] Bolke de Bruin commented on SPARK-9887: --- Yes actually. I will test the latest and

[jira] [Commented] (SPARK-8670) Nested columns can't be referenced (but they can be selected)

2015-08-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694126#comment-14694126 ] Michael Armbrust commented on SPARK-8670: - Here are the tests that cover how we

[jira] [Updated] (SPARK-9894) Writing of JSON files with MapType is broken

2015-08-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9894: Assignee: Yin Huai Writing of JSON files with MapType is broken

[jira] [Created] (SPARK-9893) User guide for VectorSlicer

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9893: Summary: User guide for VectorSlicer Key: SPARK-9893 URL: https://issues.apache.org/jira/browse/SPARK-9893 Project: Spark Issue Type: Documentation

[jira] [Created] (SPARK-9902) User guide for 1-sample KS test

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9902: Summary: User guide for 1-sample KS test Key: SPARK-9902 URL: https://issues.apache.org/jira/browse/SPARK-9902 Project: Spark Issue Type: Documentation

[jira] [Commented] (SPARK-3655) Support sorting of values in addition to keys (i.e. secondary sort)

2015-08-12 Thread SWETHARAM KASIREDDI (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694240#comment-14694240 ] SWETHARAM KASIREDDI commented on SPARK-3655: [~sandyr] [~koert] What is the

[jira] [Updated] (SPARK-9909) Move weightCol to sharedParams

2015-08-12 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-9909: --- Component/s: ML Move weightCol to sharedParams -- Key:

[jira] [Assigned] (SPARK-9908) TPCDS Q98 failed when tungsten is off

2015-08-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-9908: --- Assignee: Yin Huai TPCDS Q98 failed when tungsten is off -

[jira] [Created] (SPARK-9909) Move weightCol to sharedParams

2015-08-12 Thread holdenk (JIRA)
holdenk created SPARK-9909: -- Summary: Move weightCol to sharedParams Key: SPARK-9909 URL: https://issues.apache.org/jira/browse/SPARK-9909 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-9919) Matrices should respect Java's equals and hashCode contract

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9919: - Target Version/s: 1.5.0 Description: The contract for Java's Object is that a.equals(b)

[jira] [Created] (SPARK-9919) Matrices should respect Java's equals and hashCode contract

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9919: Summary: Matrices should respect Java's equals and hashCode contract Key: SPARK-9919 URL: https://issues.apache.org/jira/browse/SPARK-9919 Project: Spark

[jira] [Updated] (SPARK-9919) Matrices should respect Java's equals and hashCode contract

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9919: - Component/s: MLlib Matrices should respect Java's equals and hashCode contract

[jira] [Assigned] (SPARK-9918) Remove runs from KMeans under the pipeline API

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9918: --- Assignee: Xiangrui Meng (was: Apache Spark) Remove runs from KMeans under the pipeline API

[jira] [Assigned] (SPARK-9918) Remove runs from KMeans under the pipeline API

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9918: --- Assignee: Apache Spark (was: Xiangrui Meng) Remove runs from KMeans under the pipeline API

[jira] [Commented] (SPARK-9918) Remove runs from KMeans under the pipeline API

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694352#comment-14694352 ] Apache Spark commented on SPARK-9918: - User 'mengxr' has created a pull request for

[jira] [Commented] (SPARK-3655) Support sorting of values in addition to keys (i.e. secondary sort)

2015-08-12 Thread SWETHARAM KASIREDDI (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694353#comment-14694353 ] SWETHARAM KASIREDDI commented on SPARK-3655: [~koert] Could you please

[jira] [Resolved] (SPARK-9915) StopWordsRemover.stopWords should use StringArrayParam

2015-08-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9915. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8141

[jira] [Commented] (SPARK-9890) User guide for CountVectorizer

2015-08-12 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694463#comment-14694463 ] yuhao yang commented on SPARK-9890: --- Thanks. I'll start working on this. User guide

[jira] [Commented] (SPARK-3655) Support sorting of values in addition to keys (i.e. secondary sort)

2015-08-12 Thread Koert Kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694499#comment-14694499 ] Koert Kuipers commented on SPARK-3655: -- i assume you want to do some analysis on the

[jira] [Resolved] (SPARK-9855) Add expression functions into SparkR whose params are simple

2015-08-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9855. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Assigned] (SPARK-9926) Parallelize file listing for partitioned Hive table

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9926: --- Assignee: (was: Apache Spark) Parallelize file listing for partitioned Hive table

[jira] [Commented] (SPARK-9210) checkValidAggregateExpression() throws exceptions with bad error messages

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694656#comment-14694656 ] Apache Spark commented on SPARK-9210: - User 'yhuai' has created a pull request for

<    1   2   3   4   5   >