[jira] [Commented] (SPARK-3452) Maven build should skip publishing artifacts people shouldn't depend on

2015-01-07 Thread Aniket Bhatnagar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267469#comment-14267469 ] Aniket Bhatnagar commented on SPARK-3452: - Here is the exception I am getting

[jira] [Commented] (SPARK-5068) When the path not found in the hdfs,we can't get the result

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267483#comment-14267483 ] Apache Spark commented on SPARK-5068: - User 'jeanlyn' has created a pull request for

[jira] [Created] (SPARK-5131) A typo in configuration doc

2015-01-07 Thread uncleGen (JIRA)
uncleGen created SPARK-5131: --- Summary: A typo in configuration doc Key: SPARK-5131 URL: https://issues.apache.org/jira/browse/SPARK-5131 Project: Spark Issue Type: Bug Reporter:

[jira] [Closed] (SPARK-5120) Output the thread name in log4j.properties

2015-01-07 Thread WangTaoTheTonic (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] WangTaoTheTonic closed SPARK-5120. -- Resolution: Won't Fix Output the thread name in log4j.properties

[jira] [Commented] (SPARK-5131) A typo in configuration doc

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267441#comment-14267441 ] Apache Spark commented on SPARK-5131: - User 'uncleGen' has created a pull request for

[jira] [Commented] (SPARK-5129) make SqlContext support select date +/- XX DAYS from table

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267442#comment-14267442 ] Apache Spark commented on SPARK-5129: - User 'DoingDone9' has created a pull request

[jira] [Commented] (SPARK-4284) BinaryClassificationMetrics precision-recall method names should correspond to return types

2015-01-07 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267450#comment-14267450 ] Kai Sasaki commented on SPARK-4284: --- I'd like to work on this issue, if it does not

[jira] [Created] (SPARK-5132) The name for get stage info atempt ID from Json was wrong

2015-01-07 Thread SuYan (JIRA)
SuYan created SPARK-5132: Summary: The name for get stage info atempt ID from Json was wrong Key: SPARK-5132 URL: https://issues.apache.org/jira/browse/SPARK-5132 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-5132) The name for get stage info atempt ID from Json was wrong

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267454#comment-14267454 ] Apache Spark commented on SPARK-5132: - User 'suyanNone' has created a pull request for

[jira] [Commented] (SPARK-4284) BinaryClassificationMetrics precision-recall method names should correspond to return types

2015-01-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267457#comment-14267457 ] Sean Owen commented on SPARK-4284: -- [~lewuathe] I think you can just start working on it

[jira] [Created] (SPARK-5128) Add stable log1pExp impl

2015-01-07 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-5128: Summary: Add stable log1pExp impl Key: SPARK-5128 URL: https://issues.apache.org/jira/browse/SPARK-5128 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-5129) make SqlContext support select date + XX DAYS from table

2015-01-07 Thread DoingDone9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-5129: -- Description: Example : create table test (date: Date) 2014-01-01 2014-01-02 2014-01-03 when running

[jira] [Updated] (SPARK-5129) make SqlContext support select date + XX DAYS from table

2015-01-07 Thread DoingDone9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-5129: -- Description: Example : create table test (date: Date, name: String) 2014-01-01 a 2014-01-02

[jira] [Commented] (SPARK-5127) Fixed overflow when there are outliers in data in Logistic Regression

2015-01-07 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267390#comment-14267390 ] DB Tsai commented on SPARK-5127: Not an issue in binary logistic regression. Problem only

[jira] [Closed] (SPARK-5127) Fixed overflow when there are outliers in data in Logistic Regression

2015-01-07 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai closed SPARK-5127. -- Resolution: Not a Problem Fixed overflow when there are outliers in data in Logistic Regression

[jira] [Updated] (SPARK-5097) Adding data frame APIs to SchemaRDD

2015-01-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5097: --- Priority: Critical (was: Major) Adding data frame APIs to SchemaRDD

[jira] [Updated] (SPARK-5127) Fixed overflow when there are outliers in data in Logistic Regression

2015-01-07 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-5127: --- Description: gradientMultiplier = (1.0 / (1.0 + math.exp(margin))) - label However, the first part of

[jira] [Updated] (SPARK-5127) Fixed overflow when there are outliers in data in Logistic Regression

2015-01-07 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-5127: --- Description: gradientMultiplier = (1.0 / (1.0 + math.exp(margin))) - label However, the first part of

[jira] [Commented] (SPARK-4257) Spark master can only be accessed by hostname

2015-01-07 Thread Alister Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267387#comment-14267387 ] Alister Lee commented on SPARK-4257: Further, the spark URL is set correctly when

[jira] [Updated] (SPARK-5129) make SqlContext support select date + XX DAYS from table

2015-01-07 Thread DoingDone9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-5129: -- Priority: Minor (was: Major) make SqlContext support select date + XX DAYS from table

[jira] [Updated] (SPARK-5129) make SqlContext support select date + XX DAYS from table

2015-01-07 Thread DoingDone9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-5129: -- Description: Example : make SqlContext support select date + XX DAYS from table

[jira] [Updated] (SPARK-5129) make SqlContext support select date + XX DAYS from table

2015-01-07 Thread DoingDone9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-5129: -- Description: Example : create table test (date: Date, name: String) datename 2014-01-01

[jira] [Updated] (SPARK-5129) make SqlContext support select date + XX DAYS from table

2015-01-07 Thread DoingDone9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-5129: -- Description: Example : create table test (date: Date, name: String) datename 2014-01-01

[jira] [Commented] (SPARK-5128) Add stable log1pExp impl

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267391#comment-14267391 ] Apache Spark commented on SPARK-5128: - User 'dbtsai' has created a pull request for

[jira] [Updated] (SPARK-5129) make SqlContext support select date +/- XX DAYS from table

2015-01-07 Thread DoingDone9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-5129: -- Summary: make SqlContext support select date +/- XX DAYS from table (was: make SqlContext support

[jira] [Commented] (SPARK-5128) Add stable log1pExp impl

2015-01-07 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267392#comment-14267392 ] DB Tsai commented on SPARK-5128: https://github.com/apache/spark/pull/3915/commits Add

[jira] [Updated] (SPARK-5129) make SqlContext support select date +/- XX DAYS from table

2015-01-07 Thread DoingDone9 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-5129: -- Description: Example : create table test (date: Date) 2014-01-01 2014-01-02 2014-01-03 when running

[jira] [Created] (SPARK-5130) yarn-cluster mode should not be considered as client mode in spark-submit

2015-01-07 Thread WangTaoTheTonic (JIRA)
WangTaoTheTonic created SPARK-5130: -- Summary: yarn-cluster mode should not be considered as client mode in spark-submit Key: SPARK-5130 URL: https://issues.apache.org/jira/browse/SPARK-5130 Project:

[jira] [Commented] (SPARK-5130) yarn-cluster mode should not be considered as client mode in spark-submit

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267414#comment-14267414 ] Apache Spark commented on SPARK-5130: - User 'WangTaoTheTonic' has created a pull

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2015-01-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267419#comment-14267419 ] Patrick Wendell commented on SPARK-1529: Hey Sean, From what I remember of this,

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2015-01-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267424#comment-14267424 ] Patrick Wendell commented on SPARK-1529: BTW - I think if MapR wants to have a

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2015-01-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267430#comment-14267430 ] Sean Owen commented on SPARK-1529: -- [~pwendell] Gotcha, that begins to make sense. I

[jira] [Resolved] (SPARK-2641) Spark submit doesn't pick up executor instances from properties file

2015-01-07 Thread Kanwaljit Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanwaljit Singh resolved SPARK-2641. Resolution: Fixed Spark submit doesn't pick up executor instances from properties file

[jira] [Closed] (SPARK-2641) Spark submit doesn't pick up executor instances from properties file

2015-01-07 Thread Kanwaljit Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanwaljit Singh closed SPARK-2641. -- Spark submit doesn't pick up executor instances from properties file

[jira] [Commented] (SPARK-4284) BinaryClassificationMetrics precision-recall method names should correspond to return types

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267564#comment-14267564 ] Apache Spark commented on SPARK-4284: - User 'Lewuathe' has created a pull request for

[jira] [Commented] (SPARK-3619) Upgrade to Mesos 0.21 to work around MESOS-1688

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267697#comment-14267697 ] Apache Spark commented on SPARK-3619: - User 'jongyoul' has created a pull request for

[jira] [Resolved] (SPARK-4929) Yarn Client mode can not support the HA after the exitcode change

2015-01-07 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-4929. -- Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Yarn Client mode can

[jira] [Updated] (SPARK-5133) Feature Importance for Decision Tree (Ensembles)

2015-01-07 Thread Peter Prettenhofer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Prettenhofer updated SPARK-5133: -- Description: Add feature importance to decision tree model and tree ensemble models. If

[jira] [Commented] (SPARK-4284) BinaryClassificationMetrics precision-recall method names should correspond to return types

2015-01-07 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267535#comment-14267535 ] Kai Sasaki commented on SPARK-4284: --- [~srowen] It's very helpful advice. Thank you!

[jira] [Updated] (SPARK-5133) Feature Importance for Decision Tree (Ensembles)

2015-01-07 Thread Peter Prettenhofer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Prettenhofer updated SPARK-5133: -- Summary: Feature Importance for Decision Tree (Ensembles) (was: Feature Importance for

[jira] [Resolved] (SPARK-2165) spark on yarn: add support for setting maxAppAttempts in the ApplicationSubmissionContext

2015-01-07 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-2165. -- Resolution: Fixed Fix Version/s: 1.3.0 Target Version/s: 1.3.0 spark on yarn:

[jira] [Assigned] (SPARK-2165) spark on yarn: add support for setting maxAppAttempts in the ApplicationSubmissionContext

2015-01-07 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-2165: Assignee: Thomas Graves spark on yarn: add support for setting maxAppAttempts in the

[jira] [Commented] (SPARK-4908) Spark SQL built for Hive 13 fails under concurrent metadata queries

2015-01-07 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268894#comment-14268894 ] Cheng Lian commented on SPARK-4908: --- It was considered as a quick fix because we hadn't

[jira] [Commented] (SPARK-5117) Hive Generic UDFs don't cast correctly

2015-01-07 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268861#comment-14268861 ] Cheng Hao commented on SPARK-5117: -- Definitely we can do that then. Hive Generic UDFs

[jira] [Comment Edited] (SPARK-4960) Interceptor pattern in receivers

2015-01-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268886#comment-14268886 ] Saisai Shao edited comment on SPARK-4960 at 1/8/15 6:45 AM: Hi

[jira] [Commented] (SPARK-4943) Parsing error for query with table name having dot

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268830#comment-14268830 ] Apache Spark commented on SPARK-4943: - User 'alexliu68' has created a pull request for

[jira] [Commented] (SPARK-5042) Updated Receiver API to make it easier to write reliable receivers that ack source

2015-01-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268846#comment-14268846 ] Saisai Shao commented on SPARK-5042: Hey TD, what is your schedule on this? Updated

[jira] [Commented] (SPARK-4960) Interceptor pattern in receivers

2015-01-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268886#comment-14268886 ] Saisai Shao commented on SPARK-4960: Hi all, I just update the doc according to TD's

[jira] [Commented] (SPARK-5080) Expose more cluster resource information to user

2015-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268786#comment-14268786 ] Xuefu Zhang commented on SPARK-5080: cc: [~sandyr] Expose more cluster resource

[jira] [Commented] (SPARK-1825) Windows Spark fails to work with Linux YARN

2015-01-07 Thread Masayoshi TSUZUKI (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268863#comment-14268863 ] Masayoshi TSUZUKI commented on SPARK-1825: -- It is necessary to use $$() to solve

[jira] [Updated] (SPARK-5116) Add extractor for SparseVector and DenseVector in MLlib

2015-01-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5116: - Assignee: Shuo Xiang Add extractor for SparseVector and DenseVector in MLlib

[jira] [Created] (SPARK-5141) CaseInsensitiveMap throws java.io.NotSerializableException

2015-01-07 Thread Gankun Luo (JIRA)
Gankun Luo created SPARK-5141: - Summary: CaseInsensitiveMap throws java.io.NotSerializableException Key: SPARK-5141 URL: https://issues.apache.org/jira/browse/SPARK-5141 Project: Spark Issue

[jira] [Commented] (SPARK-4922) Support dynamic allocation for coarse-grained Mesos

2015-01-07 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268826#comment-14268826 ] Jongyoul Lee commented on SPARK-4922: - [~andrewor14] Hi, I have a basic question about

[jira] [Comment Edited] (SPARK-4922) Support dynamic allocation for coarse-grained Mesos

2015-01-07 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268826#comment-14268826 ] Jongyoul Lee edited comment on SPARK-4922 at 1/8/15 5:35 AM: -

[jira] [Commented] (SPARK-1825) Windows Spark fails to work with Linux YARN

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268858#comment-14268858 ] Apache Spark commented on SPARK-1825: - User 'tsudukim' has created a pull request for

[jira] [Commented] (SPARK-4908) Spark SQL built for Hive 13 fails under concurrent metadata queries

2015-01-07 Thread David Ross (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268892#comment-14268892 ] David Ross commented on SPARK-4908: --- I've verified that this is fixed on trunk. Since

[jira] [Resolved] (SPARK-5126) No error log for a typo master url

2015-01-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5126. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Shixiong Zhu No error log for a

[jira] [Resolved] (SPARK-5116) Add extractor for SparseVector and DenseVector in MLlib

2015-01-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5116. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3919

[jira] [Commented] (SPARK-4940) Support more evenly distributing cores for Mesos mode

2015-01-07 Thread Gerard Maas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268440#comment-14268440 ] Gerard Maas commented on SPARK-4940: Hi Tim, We are indeed using Coarse Grain mode.

[jira] [Comment Edited] (SPARK-4940) Support more evenly distributing cores for Mesos mode

2015-01-07 Thread Gerard Maas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268440#comment-14268440 ] Gerard Maas edited comment on SPARK-4940 at 1/7/15 10:54 PM: -

[jira] [Comment Edited] (SPARK-4940) Support more evenly distributing cores for Mesos mode

2015-01-07 Thread Gerard Maas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268440#comment-14268440 ] Gerard Maas edited comment on SPARK-4940 at 1/7/15 10:53 PM: -

[jira] [Commented] (SPARK-5136) Improve documentation around setting up Spark IntelliJ project

2015-01-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268458#comment-14268458 ] Sean Owen commented on SPARK-5136: -- [~pwendell] Before I suggest a change to the IntelliJ

[jira] [Commented] (SPARK-2541) Standalone mode can't access secure HDFS anymore

2015-01-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268475#comment-14268475 ] Nicholas Chammas commented on SPARK-2541: - By the way, should this issue be linked

[jira] [Commented] (SPARK-2541) Standalone mode can't access secure HDFS anymore

2015-01-07 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268480#comment-14268480 ] Thomas Graves commented on SPARK-2541: -- Yeah kind of. I guess 3438 is to officially

[jira] [Commented] (SPARK-3910) ./python/pyspark/mllib/classification.py doctests fails with module name pollution

2015-01-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268529#comment-14268529 ] Davies Liu commented on SPARK-3910: --- [~joshrosen] I think we should backport SPARK-4348

[jira] [Updated] (SPARK-4879) Missing output partitions after job completes with speculative execution

2015-01-07 Thread Zach Fry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zach Fry updated SPARK-4879: Attachment: speculation2.txt speculation.txt Hey Josh, I have been playing around with

[jira] [Created] (SPARK-5139) select table_alias.* with joins and selecting column names from inner queries not supported

2015-01-07 Thread Sunita Koppar (JIRA)
Sunita Koppar created SPARK-5139: Summary: select table_alias.* with joins and selecting column names from inner queries not supported Key: SPARK-5139 URL: https://issues.apache.org/jira/browse/SPARK-5139

[jira] [Comment Edited] (SPARK-4940) Support more evenly distributing cores for Mesos mode

2015-01-07 Thread Gerard Maas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268440#comment-14268440 ] Gerard Maas edited comment on SPARK-4940 at 1/7/15 10:52 PM: -

[jira] [Updated] (SPARK-4951) A busy executor may be killed when dynamicAllocation is enabled

2015-01-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4951: - Assignee: Shixiong Zhu A busy executor may be killed when dynamicAllocation is enabled

[jira] [Commented] (SPARK-3910) ./python/pyspark/mllib/classification.py doctests fails with module name pollution

2015-01-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268496#comment-14268496 ] Davies Liu commented on SPARK-3910: --- The 1.2 branch should not fail in a clean

[jira] [Commented] (SPARK-3910) ./python/pyspark/mllib/classification.py doctests fails with module name pollution

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268498#comment-14268498 ] Josh Rosen commented on SPARK-3910: --- Oh, I noticed this in 1.1 (while setting up SBT

[jira] [Commented] (SPARK-3910) ./python/pyspark/mllib/classification.py doctests fails with module name pollution

2015-01-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268559#comment-14268559 ] Davies Liu commented on SPARK-3910: --- It does not have random.py in branch-1.0, so 1.1 is

[jira] [Commented] (SPARK-3789) Python bindings for GraphX

2015-01-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268640#comment-14268640 ] Davies Liu commented on SPARK-3789: --- Any updates? Python bindings for GraphX

[jira] [Commented] (SPARK-3789) Python bindings for GraphX

2015-01-07 Thread Kushal Datta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268649#comment-14268649 ] Kushal Datta commented on SPARK-3789: - Hi Davies, Here are the list of things which I

[jira] [Commented] (SPARK-5136) Improve documentation around setting up Spark IntelliJ project

2015-01-07 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268146#comment-14268146 ] Ryan Williams commented on SPARK-5136: -- I've not started on it so feel free to grab

[jira] [Commented] (SPARK-5136) Improve documentation around setting up Spark IntelliJ project

2015-01-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268106#comment-14268106 ] Sean Owen commented on SPARK-5136: -- [~rdub] Are you taking a crack at this or should I? I

[jira] [Updated] (SPARK-5039) Spark 1.0 2.0.0-mr1-cdh4.1.2 Maven build fails due to javax.servlet.FilterRegistration's signer information errors

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5039: -- Assignee: Sean Owen Spark 1.0 2.0.0-mr1-cdh4.1.2 Maven build fails due to

[jira] [Resolved] (SPARK-5132) The name for get stage info atempt ID from Json was wrong

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5132. --- Resolution: Fixed Fix Version/s: (was: 1.2.0) 1.2.1

[jira] [Commented] (SPARK-5108) Need to make jackson dependency version consistent with hadoop-2.6.0.

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268241#comment-14268241 ] Apache Spark commented on SPARK-5108: - User 'zhzhan' has created a pull request for

[jira] [Updated] (SPARK-4389) Set akka.remote.netty.tcp.bind-hostname=0.0.0.0 so driver can be located behind NAT

2015-01-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4389: - Affects Version/s: 1.2.0 Set akka.remote.netty.tcp.bind-hostname=0.0.0.0 so driver can be located

[jira] [Commented] (SPARK-4906) Spark master OOMs with exception stack trace stored in JobProgressListener

2015-01-07 Thread Zach Fry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268113#comment-14268113 ] Zach Fry commented on SPARK-4906: - [~pwendell], Looks like you wanted to ping [~mkim].

[jira] [Commented] (SPARK-4406) SVD should check for k 1

2015-01-07 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268180#comment-14268180 ] Manoj Kumar commented on SPARK-4406: Hi Joseph, I believe this issue would be simple

[jira] [Updated] (SPARK-2298) Show stage attempt in UI

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-2298: -- Fix Version/s: 1.1.0 Show stage attempt in UI Key:

[jira] [Updated] (SPARK-5132) The name for get stage info atempt ID from Json was wrong

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5132: -- Component/s: Web UI The name for get stage info atempt ID from Json was wrong

[jira] [Updated] (SPARK-5132) The name for get stage info atempt ID from Json was wrong

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5132: -- Assignee: SuYan The name for get stage info atempt ID from Json was wrong

[jira] [Comment Edited] (SPARK-4406) SVD should check for k 1

2015-01-07 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268180#comment-14268180 ] Manoj Kumar edited comment on SPARK-4406 at 1/7/15 8:40 PM: Hi

[jira] [Commented] (SPARK-3619) Upgrade to Mesos 0.21 to work around MESOS-1688

2015-01-07 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267701#comment-14267701 ] Jongyoul Lee commented on SPARK-3619: - [~tnachen] fixing the version from 0.18.1 to

[jira] [Closed] (SPARK-2458) Make failed application log visible on History Server

2015-01-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2458. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Masayoshi TSUZUKI Target

[jira] [Commented] (SPARK-5053) Test maintenance branches on Jenkins using SBT

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268313#comment-14268313 ] Josh Rosen commented on SPARK-5053: --- It looks like nearly all of these new builds are

[jira] [Commented] (SPARK-5108) Need to make jackson dependency version consistent with hadoop-2.6.0.

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268336#comment-14268336 ] Apache Spark commented on SPARK-5108: - User 'zhzhan' has created a pull request for

[jira] [Commented] (SPARK-4406) SVD should check for k 1

2015-01-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268358#comment-14268358 ] Joseph K. Bradley commented on SPARK-4406: -- It's good to get it assigned if it

[jira] [Commented] (SPARK-5053) Test maintenance branches on Jenkins using SBT

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268321#comment-14268321 ] Josh Rosen commented on SPARK-5053: --- Hmm, it looks like the Python issue is an

[jira] [Commented] (SPARK-3910) ./python/pyspark/mllib/classification.py doctests fails with module name pollution

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268332#comment-14268332 ] Josh Rosen commented on SPARK-3910: --- It looks like this was fixed in SPARK-4348, but it

[jira] [Commented] (SPARK-4406) SVD should check for k 1

2015-01-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268368#comment-14268368 ] Joseph K. Bradley commented on SPARK-4406: -- Also, to get JIRAs assigned to you,

[jira] [Commented] (SPARK-5122) Remove Shark from spark-ec2

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268390#comment-14268390 ] Apache Spark commented on SPARK-5122: - User 'nchammas' has created a pull request for

[jira] [Updated] (SPARK-4951) A busy executor may be killed when dynamicAllocation is enabled

2015-01-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4951: - Affects Version/s: 1.2.0 A busy executor may be killed when dynamicAllocation is enabled

[jira] [Updated] (SPARK-4983) Tag EC2 instances in the same call that launches them

2015-01-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4983: Labels: starter (was: ) Tag EC2 instances in the same call that launches them

[jira] [Commented] (SPARK-3910) ./python/pyspark/mllib/classification.py doctests fails with module name pollution

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268411#comment-14268411 ] Apache Spark commented on SPARK-3910: - User 'JoshRosen' has created a pull request for

[jira] [Commented] (SPARK-3789) Python bindings for GraphX

2015-01-07 Thread Ameet Talwalkar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268658#comment-14268658 ] Ameet Talwalkar commented on SPARK-3789: Agreed, thanks for the update! Also,

[jira] [Updated] (SPARK-4777) Some block memory after unrollSafely not count into used memory(memoryStore.entrys or unrollMemory)

2015-01-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4777: - Priority: Major (was: Minor) Some block memory after unrollSafely not count into used

  1   2   >