[jira] [Commented] (SPARK-5127) Fixed overflow when there are outliers in data in Logistic Regression

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267381#comment-14267381 ] Apache Spark commented on SPARK-5127: - User 'dbtsai' has created a pull request for th

[jira] [Commented] (SPARK-5115) Intellij fails to find hadoop classes in Spark "yarn" modules

2015-01-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267379#comment-14267379 ] Sean Owen commented on SPARK-5115: -- This tab is always available from the "Maven Projects

[jira] [Created] (SPARK-5127) Fixed overflow when there are outliers in data in Logistic Regression

2015-01-06 Thread DB Tsai (JIRA)
DB Tsai created SPARK-5127: -- Summary: Fixed overflow when there are outliers in data in Logistic Regression Key: SPARK-5127 URL: https://issues.apache.org/jira/browse/SPARK-5127 Project: Spark Issu

[jira] [Updated] (SPARK-4948) Use pssh instead of bash-isms and remove unnecessary operations

2015-01-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-4948: - Assignee: Nicholas Chammas > Use pssh instead of bash-isms and remove unnecessary

[jira] [Commented] (SPARK-5126) No error log for a typo master url

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267341#comment-14267341 ] Apache Spark commented on SPARK-5126: - User 'zsxwing' has created a pull request for t

[jira] [Created] (SPARK-5126) No error log for a typo master url

2015-01-06 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-5126: --- Summary: No error log for a typo master url Key: SPARK-5126 URL: https://issues.apache.org/jira/browse/SPARK-5126 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-5125) Time major blocks of code in spark-ec2/setup.sh

2015-01-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267333#comment-14267333 ] Nicholas Chammas commented on SPARK-5125: - [~shivaram] Please assign this issue to

[jira] [Resolved] (SPARK-5117) Hive Generic UDFs don't cast correctly

2015-01-06 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao resolved SPARK-5117. -- Resolution: Won't Fix This IS NOT a bug of Spark SQL. Hive changed the LPAD implementation since Hive 0

[jira] [Created] (SPARK-5125) Time major blocks of code in spark-ec2/setup.sh

2015-01-06 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-5125: --- Summary: Time major blocks of code in spark-ec2/setup.sh Key: SPARK-5125 URL: https://issues.apache.org/jira/browse/SPARK-5125 Project: Spark Issue Typ

[jira] [Commented] (SPARK-4948) Use pssh instead of bash-isms and remove unnecessary operations

2015-01-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267331#comment-14267331 ] Nicholas Chammas commented on SPARK-4948: - [~shivaram] Could you assign this issue

[jira] [Updated] (SPARK-4948) Use pssh instead of bash-isms and remove unnecessary operations

2015-01-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4948: Target Version/s: 1.3.0 > Use pssh instead of bash-isms and remove unnecessary operations >

[jira] [Resolved] (SPARK-4948) Use pssh instead of bash-isms and remove unnecessary operations

2015-01-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-4948. - Resolution: Fixed Resolved by: https://github.com/mesos/spark-ec2/pull/86 > Use pssh inst

[jira] [Commented] (SPARK-926) spark_ec2 script when ssh/scp-ing should pipe UserknowHostFile to /dev/null

2015-01-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267327#comment-14267327 ] Nicholas Chammas commented on SPARK-926: [~shay] / [~shayping] (pinging both names

[jira] [Closed] (SPARK-5121) Stored as parquet doens't support the CTAS

2015-01-06 Thread XiaoJing wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoJing wang closed SPARK-5121. Resolution: Fixed > Stored as parquet doens't support the CTAS > ---

[jira] [Commented] (SPARK-5009) allCaseVersions function in SqlLexical leads to StackOverflow Exception

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267317#comment-14267317 ] Apache Spark commented on SPARK-5009: - User 'chenghao-intel' has created a pull reques

[jira] [Created] (SPARK-5124) Standardize internal RPC interface

2015-01-06 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-5124: -- Summary: Standardize internal RPC interface Key: SPARK-5124 URL: https://issues.apache.org/jira/browse/SPARK-5124 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-5123) Expose only one version of the data type APIs (i.e. remove the Java-specific API)

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267301#comment-14267301 ] Apache Spark commented on SPARK-5123: - User 'rxin' has created a pull request for this

[jira] [Updated] (SPARK-5123) Expose only one version of the data type APIs (i.e. remove the Java-specific API)

2015-01-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5123: --- Summary: Expose only one version of the data type APIs (i.e. remove the Java-specific API) (was: Expo

[jira] [Created] (SPARK-5123) Expose only one version of the data type APIs

2015-01-06 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-5123: -- Summary: Expose only one version of the data type APIs Key: SPARK-5123 URL: https://issues.apache.org/jira/browse/SPARK-5123 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-5122) Remove Shark from spark-ec2

2015-01-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5122: Description: Since Shark has been replaced by Spark SQL, we don't need it in {{spark-ec2}} a

[jira] [Commented] (SPARK-5122) Remove Shark from spark-ec2

2015-01-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267296#comment-14267296 ] Shivaram Venkataraman commented on SPARK-5122: -- Yes I think removing shark sh

[jira] [Updated] (SPARK-5099) Simplify logistic loss function

2015-01-06 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5099: - Assignee: Liang-Chi Hsieh > Simplify logistic loss function > --- > >

[jira] [Resolved] (SPARK-5099) Simplify logistic loss function

2015-01-06 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5099. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3899 [https://githu

[jira] [Commented] (SPARK-5009) allCaseVersions function in SqlLexical leads to StackOverflow Exception

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267282#comment-14267282 ] Apache Spark commented on SPARK-5009: - User 'chenghao-intel' has created a pull reques

[jira] [Updated] (SPARK-5122) Remove Shark from spark-ec2

2015-01-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5122: Description: Since Shark has been replaced by Spark SQL, we don't need it in {{spark-ec2}} a

[jira] [Commented] (SPARK-5122) Remove Shark from spark-ec2

2015-01-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267281#comment-14267281 ] Nicholas Chammas commented on SPARK-5122: - cc [~shivaram] - Is it appropriate to j

[jira] [Updated] (SPARK-5122) Remove Shark from spark-ec2

2015-01-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5122: Summary: Remove Shark from spark-ec2 (was: Remove Shark from spark-ec2 modules) > Remove S

[jira] [Created] (SPARK-5122) Remove Shark from spark-ec2 modules

2015-01-06 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-5122: --- Summary: Remove Shark from spark-ec2 modules Key: SPARK-5122 URL: https://issues.apache.org/jira/browse/SPARK-5122 Project: Spark Issue Type: Improveme

[jira] [Commented] (SPARK-5018) Make MultivariateGaussian public

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267259#comment-14267259 ] Apache Spark commented on SPARK-5018: - User 'tgaloppo' has created a pull request for

[jira] [Commented] (SPARK-5120) Output the thread name in log4j.properties

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267256#comment-14267256 ] Apache Spark commented on SPARK-5120: - User 'WangTaoTheTonic' has created a pull reque

[jira] [Created] (SPARK-5121) Stored as parquet doens't support the CTAS

2015-01-06 Thread XiaoJing wang (JIRA)
XiaoJing wang created SPARK-5121: Summary: Stored as parquet doens't support the CTAS Key: SPARK-5121 URL: https://issues.apache.org/jira/browse/SPARK-5121 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-5120) Output the thread name in log4j.properties

2015-01-06 Thread WangTaoTheTonic (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] WangTaoTheTonic updated SPARK-5120: --- Issue Type: Improvement (was: Bug) > Output the thread name in log4j.properties > ---

[jira] [Created] (SPARK-5120) Output the thread name in log4j.properties

2015-01-06 Thread WangTaoTheTonic (JIRA)
WangTaoTheTonic created SPARK-5120: -- Summary: Output the thread name in log4j.properties Key: SPARK-5120 URL: https://issues.apache.org/jira/browse/SPARK-5120 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-5119) java.lang.ArrayIndexOutOfBoundsException on trying to train decision tree model

2015-01-06 Thread Vivek Kulkarni (JIRA)
Vivek Kulkarni created SPARK-5119: - Summary: java.lang.ArrayIndexOutOfBoundsException on trying to train decision tree model Key: SPARK-5119 URL: https://issues.apache.org/jira/browse/SPARK-5119 Proje

[jira] [Updated] (SPARK-5118) "Create table test stored as parquet as select ..." report error

2015-01-06 Thread guowei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guowei updated SPARK-5118: -- Description: Caused by: java.lang.RuntimeException: Unhandled clauses: TOK_TBLPARQUETFILE > "Create table test

[jira] [Commented] (SPARK-5104) Distributed Representations of Sentences and Documents

2015-01-06 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267226#comment-14267226 ] Guoqiang Li commented on SPARK-5104: Dimension reduction in text classification. It h

[jira] [Commented] (SPARK-5118) "Create table test stored as parquet as select ..." report error

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267224#comment-14267224 ] Apache Spark commented on SPARK-5118: - User 'guowei2' has created a pull request for t

[jira] [Created] (SPARK-5118) "Create table test stored as parquet as select ..." report error

2015-01-06 Thread guowei (JIRA)
guowei created SPARK-5118: - Summary: "Create table test stored as parquet as select ..." report error Key: SPARK-5118 URL: https://issues.apache.org/jira/browse/SPARK-5118 Project: Spark Issue Type:

[jira] [Updated] (SPARK-5088) Use spark-class for running executors directly

2015-01-06 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-5088: Issue Type: Improvement (was: Task) > Use spark-class for running executors directly >

[jira] [Updated] (SPARK-5088) Use spark-class for running executors directly

2015-01-06 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-5088: Issue Type: Task (was: Bug) > Use spark-class for running executors directly >

[jira] [Created] (SPARK-5117) Hive Generic UDFs don't cast correctly

2015-01-06 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-5117: --- Summary: Hive Generic UDFs don't cast correctly Key: SPARK-5117 URL: https://issues.apache.org/jira/browse/SPARK-5117 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-5115) Intellij fails to find hadoop classes in Spark "yarn" modules

2015-01-06 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Williams resolved SPARK-5115. -- Resolution: Not a Problem > Intellij fails to find hadoop classes in Spark "yarn" modules >

[jira] [Commented] (SPARK-5115) Intellij fails to find hadoop classes in Spark "yarn" modules

2015-01-06 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267190#comment-14267190 ] Ryan Williams commented on SPARK-5115: -- well what do you know, I did a fresh import a

[jira] [Commented] (SPARK-5090) The improvement of python converter for hbase

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267184#comment-14267184 ] Apache Spark commented on SPARK-5090: - User 'GenTang' has created a pull request for t

[jira] [Updated] (SPARK-5116) Add extractor for SparseVector and DenseVector in MLlib

2015-01-06 Thread Shuo Xiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Xiang updated SPARK-5116: -- Description: Add extractor for SparseVector and DenseVector in MLlib to save some code while performing

[jira] [Updated] (SPARK-5116) Add extractor for SparseVector and DenseVector in MLlib

2015-01-06 Thread Shuo Xiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Xiang updated SPARK-5116: -- Description: Add extractor for SparseVector and DenseVector in MLlib to save some code while performing

[jira] [Commented] (SPARK-5116) Add extractor for SparseVector and DenseVector in MLlib

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267176#comment-14267176 ] Apache Spark commented on SPARK-5116: - User 'coderxiang' has created a pull request fo

[jira] [Created] (SPARK-5116) Add extractor for SparseVector and DenseVector in MLlib

2015-01-06 Thread Shuo Xiang (JIRA)
Shuo Xiang created SPARK-5116: - Summary: Add extractor for SparseVector and DenseVector in MLlib Key: SPARK-5116 URL: https://issues.apache.org/jira/browse/SPARK-5116 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3619) Upgrade to Mesos 0.21 to work around MESOS-1688

2015-01-06 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267168#comment-14267168 ] Jongyoul Lee commented on SPARK-3619: - Ok, I'll handle it. > Upgrade to Mesos 0.21 to

[jira] [Commented] (SPARK-5115) Intellij fails to find hadoop classes in Spark "yarn" modules

2015-01-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267074#comment-14267074 ] Sean Owen commented on SPARK-5115: -- I just deleted my IntelliJ project config for Spark (

[jira] [Comment Edited] (SPARK-5019) Update GMM API to use MultivariateGaussian

2015-01-06 Thread Travis Galoppo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267061#comment-14267061 ] Travis Galoppo edited comment on SPARK-5019 at 1/7/15 12:24 AM:

[jira] [Commented] (SPARK-5019) Update GMM API to use MultivariateGaussian

2015-01-06 Thread Travis Galoppo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267061#comment-14267061 ] Travis Galoppo commented on SPARK-5019: --- No problem,@lewuathe ... I have just starte

[jira] [Commented] (SPARK-5115) Intellij fails to find hadoop classes in Spark "yarn" modules

2015-01-06 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267047#comment-14267047 ] Ryan Williams commented on SPARK-5115: -- FTR the IntelliJ problem I'm referring to is

[jira] [Commented] (SPARK-5115) Intellij fails to find hadoop classes in Spark "yarn" modules

2015-01-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267041#comment-14267041 ] Sean Owen commented on SPARK-5115: -- This is only a problem if you enable the {{yarn}} pro

[jira] [Updated] (SPARK-5115) Intellij fails to find hadoop classes in Spark "yarn" modules

2015-01-06 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Williams updated SPARK-5115: - Description: Intellij's parsing of Spark's POMs works like a charm for the most part, however it

[jira] [Commented] (SPARK-5115) Intellij fails to find hadoop classes in Spark "yarn" modules

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267036#comment-14267036 ] Apache Spark commented on SPARK-5115: - User 'ryan-williams' has created a pull request

[jira] [Commented] (SPARK-5115) Intellij fails to find hadoop classes in Spark "yarn" modules

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267035#comment-14267035 ] Apache Spark commented on SPARK-5115: - User 'ryan-williams' has created a pull request

[jira] [Created] (SPARK-5115) Intellij fails to find hadoop classes in Spark "yarn" modules

2015-01-06 Thread Ryan Williams (JIRA)
Ryan Williams created SPARK-5115: Summary: Intellij fails to find hadoop classes in Spark "yarn" modules Key: SPARK-5115 URL: https://issues.apache.org/jira/browse/SPARK-5115 Project: Spark

[jira] [Updated] (SPARK-5114) Should Evaluator by a PipelineStage

2015-01-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5114: - Component/s: ML Description: Pipelines can currently contain Estimators an

[jira] [Created] (SPARK-5114) Should

2015-01-06 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-5114: Summary: Should Key: SPARK-5114 URL: https://issues.apache.org/jira/browse/SPARK-5114 Project: Spark Issue Type: Question Reporter: Jose

[jira] [Commented] (SPARK-5019) Update GMM API to use MultivariateGaussian

2015-01-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266997#comment-14266997 ] Joseph K. Bradley commented on SPARK-5019: -- No problem; thanks for your understan

[jira] [Commented] (SPARK-5019) Update GMM API to use MultivariateGaussian

2015-01-06 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266986#comment-14266986 ] Kai Sasaki commented on SPARK-5019: --- I'm sorry for submitting premature PR. Is it OK to

[jira] [Updated] (SPARK-5018) Make MultivariateGaussian public

2015-01-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5018: - Assignee: Travis Galoppo > Make MultivariateGaussian public >

[jira] [Commented] (SPARK-5019) Update GMM API to use MultivariateGaussian

2015-01-06 Thread Travis Galoppo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266909#comment-14266909 ] Travis Galoppo commented on SPARK-5019: --- This really can't be completed until Multiv

[jira] [Commented] (SPARK-5018) Make MultivariateGaussian public

2015-01-06 Thread Travis Galoppo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266907#comment-14266907 ] Travis Galoppo commented on SPARK-5018: --- Please assign this ticket to me. > Make M

[jira] [Commented] (SPARK-4924) Factor out code to launch Spark applications into a separate library

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266897#comment-14266897 ] Apache Spark commented on SPARK-4924: - User 'vanzin' has created a pull request for th

[jira] [Updated] (SPARK-5050) Add unit test for sqdist

2015-01-06 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5050: - Assignee: Liang-Chi Hsieh > Add unit test for sqdist > > >

[jira] [Resolved] (SPARK-5050) Add unit test for sqdist

2015-01-06 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5050. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3869 [https://githu

[jira] [Resolved] (SPARK-5017) GaussianMixtureEM should use SVD for Gaussian initialization

2015-01-06 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5017. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3871 [https://githu

[jira] [Commented] (SPARK-5101) Add common ML math functions

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266755#comment-14266755 ] Apache Spark commented on SPARK-5101: - User 'dbtsai' has created a pull request for th

[jira] [Closed] (SPARK-5110) Spark-on-Yarn does not work on windows platform

2015-01-06 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang closed SPARK-5110. - Resolution: Duplicate > Spark-on-Yarn does not work on windows platform >

[jira] [Commented] (SPARK-5110) Spark-on-Yarn does not work on windows platform

2015-01-06 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266744#comment-14266744 ] Zhan Zhang commented on SPARK-5110: --- You are right. I will make this duplicated. > Spar

[jira] [Commented] (SPARK-5019) Update GMM API to use MultivariateGaussian

2015-01-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266740#comment-14266740 ] Joseph K. Bradley commented on SPARK-5019: -- [~lewuathe] I would recommend gettin

[jira] [Commented] (SPARK-5108) Need to make jackson dependency version consistent with hadoop-2.6.0.

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266729#comment-14266729 ] Apache Spark commented on SPARK-5108: - User 'zhzhan' has created a pull request for th

[jira] [Updated] (SPARK-5108) Need to make jackson dependency version consistent with hadoop-2.6.0.

2015-01-06 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated SPARK-5108: -- Summary: Need to make jackson dependency version consistent with hadoop-2.6.0. (was: Need to add more j

[jira] [Updated] (SPARK-5113) Audit and document use of hostnames and IP addresses in Spark

2015-01-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5113: --- Description: Spark has multiple network components that start servers and advertise their net

[jira] [Updated] (SPARK-5113) Audit and document use of hostnames and IP addresses in Spark

2015-01-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5113: --- Description: Spark has multiple network components that start servers and advertise their net

[jira] [Updated] (SPARK-5113) Audit and document use of hostnames and IP addresses in Spark

2015-01-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5113: --- Description: Spark has multiple network components that start servers and advertise their net

[jira] [Updated] (SPARK-5113) Audit and document use of hostnames and IP addresses in Spark

2015-01-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5113: --- Description: Spark has multiple network components that start servers and advertise their net

[jira] [Created] (SPARK-5113) Audit and document use of hostnames and IP addresses in Spark

2015-01-06 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-5113: -- Summary: Audit and document use of hostnames and IP addresses in Spark Key: SPARK-5113 URL: https://issues.apache.org/jira/browse/SPARK-5113 Project: Spark

[jira] [Updated] (SPARK-4159) Maven build doesn't run JUnit test suites

2015-01-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4159: -- Target Version/s: 1.1.1, 1.0.3, 1.2.1 Fix Version/s: 1.3.0 Assignee: Sean Owen

[jira] [Commented] (SPARK-5112) Expose SizeEstimator as a developer API

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266646#comment-14266646 ] Apache Spark commented on SPARK-5112: - User 'sryza' has created a pull request for thi

[jira] [Created] (SPARK-5112) Expose SizeEstimator as a developer API

2015-01-06 Thread Sandy Ryza (JIRA)
Sandy Ryza created SPARK-5112: - Summary: Expose SizeEstimator as a developer API Key: SPARK-5112 URL: https://issues.apache.org/jira/browse/SPARK-5112 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-5019) Update GMM API to use MultivariateGaussian

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266598#comment-14266598 ] Apache Spark commented on SPARK-5019: - User 'Lewuathe' has created a pull request for

[jira] [Commented] (SPARK-5110) Spark-on-Yarn does not work on windows platform

2015-01-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266599#comment-14266599 ] Sean Owen commented on SPARK-5110: -- [~zhanzhang] are you intending to add any detail to t

[jira] [Commented] (SPARK-5107) A trick log info for the start of Receiver

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266597#comment-14266597 ] Apache Spark commented on SPARK-5107: - User 'uncleGen' has created a pull request for

[jira] [Commented] (SPARK-4296) Throw "Expression not in GROUP BY" when using same expression in group by clause and select clause

2015-01-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266589#comment-14266589 ] Apache Spark commented on SPARK-4296: - User 'liancheng' has created a pull request for

[jira] [Updated] (SPARK-5075) Memory Leak when repartitioning SchemaRDD or running queries in general

2015-01-06 Thread Brad Willard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brad Willard updated SPARK-5075: Labels: ec2 json memory-leak memory_leak parquet pyspark repartition s3 (was: ec2 json parquet pysp

[jira] [Updated] (SPARK-5075) Memory Leak when repartitioning SchemaRDD or running queries in general

2015-01-06 Thread Brad Willard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brad Willard updated SPARK-5075: Description: I'm trying to repartition a json dataset for better cpu optimization and save in parqu

[jira] [Updated] (SPARK-5075) Memory Leak when repartitioning SchemaRDD or running queries in general

2015-01-06 Thread Brad Willard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brad Willard updated SPARK-5075: Summary: Memory Leak when repartitioning SchemaRDD or running queries in general (was: Memory Leak

[jira] [Created] (SPARK-5111) HiveContext and Thriftserver cannot work in secure cluster beyond hadoop2.5

2015-01-06 Thread Zhan Zhang (JIRA)
Zhan Zhang created SPARK-5111: - Summary: HiveContext and Thriftserver cannot work in secure cluster beyond hadoop2.5 Key: SPARK-5111 URL: https://issues.apache.org/jira/browse/SPARK-5111 Project: Spark

[jira] [Created] (SPARK-5110) Spark-on-Yarn does not work on windows platform

2015-01-06 Thread Zhan Zhang (JIRA)
Zhan Zhang created SPARK-5110: - Summary: Spark-on-Yarn does not work on windows platform Key: SPARK-5110 URL: https://issues.apache.org/jira/browse/SPARK-5110 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-5108) Need to add more jackson dependency for hadoop-2.6.0 support.

2015-01-06 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266530#comment-14266530 ] Zhan Zhang commented on SPARK-5108: --- java.lang.NoSuchMethodError: org.codehaus.jackson.

[jira] [Commented] (SPARK-5108) Need to add more jackson dependency for hadoop-2.6.0 support.

2015-01-06 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266529#comment-14266529 ] Zhan Zhang commented on SPARK-5108: --- [~sowen] You are right. > Need to add more jacks

[jira] [Commented] (SPARK-5108) Need to add more jackson dependency for hadoop-2.6.0 support.

2015-01-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266499#comment-14266499 ] Sean Owen commented on SPARK-5108: -- Let me see if I can guess the detail: are you referri

[jira] [Updated] (SPARK-5109) Loading multiple parquet files into a single SQL table

2015-01-06 Thread Sam Steingold (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Steingold updated SPARK-5109: - Description: {{[SQLContext.parquetFile(String)|http://spark.apache.org/docs/1.2.0/api/java/org/apa

[jira] [Created] (SPARK-5109) Loading multiple parquet files into a single SQL table

2015-01-06 Thread Sam Steingold (JIRA)
Sam Steingold created SPARK-5109: Summary: Loading multiple parquet files into a single SQL table Key: SPARK-5109 URL: https://issues.apache.org/jira/browse/SPARK-5109 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-5105) A better log info for the start of receiver

2015-01-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5105. -- Resolution: Duplicate I assume this was accidentally created in the course of opening SPARK-5107 > A be

[jira] [Created] (SPARK-5108) Need to add more jackson dependency for hadoop-2.6.0 support.

2015-01-06 Thread Zhan Zhang (JIRA)
Zhan Zhang created SPARK-5108: - Summary: Need to add more jackson dependency for hadoop-2.6.0 support. Key: SPARK-5108 URL: https://issues.apache.org/jira/browse/SPARK-5108 Project: Spark Issue

[jira] [Updated] (SPARK-5107) A trick log info for the start of Receiver

2015-01-06 Thread uncleGen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] uncleGen updated SPARK-5107: Description: Receiver will register itself whenever it begins to start. But, it is trick to log the same in

  1   2   >