[jira] [Commented] (SPARK-2172) PySpark cannot import mllib modules in YARN-client mode

2014-08-25 Thread Joao Salcedo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108783#comment-14108783 ] Joao Salcedo commented on SPARK-2172: - [~piotrszul] For the fix there is a workaround

[jira] [Commented] (SPARK-3190) Creation of large graph( 2.15 B nodes) seems to be broken:possible overflow somewhere

2014-08-25 Thread npanj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108794#comment-14108794 ] npanj commented on SPARK-3190: -- Thanks Ankur for patch. I can confirm that this pull request

[jira] [Commented] (SPARK-2805) update akka to version 2.3

2014-08-25 Thread Anand Avati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108800#comment-14108800 ] Anand Avati commented on SPARK-2805: [~pwendell] ping update akka to version 2.3

[jira] [Created] (SPARK-3197) Reduce the expression tree object creation from the aggregation functions (min/max)

2014-08-25 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-3197: Summary: Reduce the expression tree object creation from the aggregation functions (min/max) Key: SPARK-3197 URL: https://issues.apache.org/jira/browse/SPARK-3197 Project:

[jira] [Created] (SPARK-3196) Expression Evaluation Performance Improvement

2014-08-25 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-3196: Summary: Expression Evaluation Performance Improvement Key: SPARK-3196 URL: https://issues.apache.org/jira/browse/SPARK-3196 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-3198) Improve the expression id generation algorithm

2014-08-25 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-3198: Summary: Improve the expression id generation algorithm Key: SPARK-3198 URL: https://issues.apache.org/jira/browse/SPARK-3198 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-3193) output errer info when Process exitcode not zero

2014-08-25 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-3193. Resolution: Invalid [Verbatim from my comment on PR ] Hey !, Thanks for raising this

[jira] [Commented] (SPARK-3197) Reduce the expression tree object creation from the aggregation functions (min/max)

2014-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108869#comment-14108869 ] Apache Spark commented on SPARK-3197: - User 'chenghao-intel' has created a pull

[jira] [Created] (SPARK-3199) native Java spark listener API support

2014-08-25 Thread Chengxiang Li (JIRA)
Chengxiang Li created SPARK-3199: Summary: native Java spark listener API support Key: SPARK-3199 URL: https://issues.apache.org/jira/browse/SPARK-3199 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-2633) enhance spark listener API to gather more spark job information

2014-08-25 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated SPARK-2633: - Summary: enhance spark listener API to gather more spark job information (was: support register

[jira] [Updated] (SPARK-2633) enhance spark listener API to gather more spark job information

2014-08-25 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated SPARK-2633: - Description: Based on Hive on Spark job status monitoring and statistic collection requirement,

[jira] [Updated] (SPARK-3198) Generates the expression id while necessary

2014-08-25 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-3198: - Summary: Generates the expression id while necessary (was: Improve the expression id generation

[jira] [Commented] (SPARK-2633) enhance spark listener API to gather more spark job information

2014-08-25 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108887#comment-14108887 ] Chengxiang Li commented on SPARK-2633: -- I would start to work on this issue, for

[jira] [Updated] (SPARK-3196) Expression Evaluation Performance Improvement

2014-08-25 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-3196: - Description: The expression id generations depend on a atomic long object internally, which will cause

[jira] [Commented] (SPARK-3198) Generates the expression id while necessary

2014-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108891#comment-14108891 ] Apache Spark commented on SPARK-3198: - User 'chenghao-intel' has created a pull

[jira] [Commented] (SPARK-3198) Generates the expression id while necessary

2014-08-25 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108894#comment-14108894 ] Cheng Hao commented on SPARK-3198: -- Usually, we need the expression id in logical plan

[jira] [Commented] (SPARK-3173) Timestamp support in the parser

2014-08-25 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108936#comment-14108936 ] Teng Qiu commented on SPARK-3173: - vote on this ticket, it seems should link to this PR

[jira] [Commented] (SPARK-2620) case class cannot be used as key for reduce

2014-08-25 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108958#comment-14108958 ] Prashant Sharma commented on SPARK-2620: I just tried these test code snippets on

[jira] [Created] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2014-08-25 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-3200: -- Summary: Class defined with reference to external variables crashes in REPL. Key: SPARK-3200 URL: https://issues.apache.org/jira/browse/SPARK-3200 Project: Spark

[jira] [Created] (SPARK-3201) Yarn Client do not support the -X java opts

2014-08-25 Thread hzw (JIRA)
hzw created SPARK-3201: -- Summary: Yarn Client do not support the -X java opts Key: SPARK-3201 URL: https://issues.apache.org/jira/browse/SPARK-3201 Project: Spark Issue Type: Bug Components:

[jira] [Created] (SPARK-3203) ClassNotFound Exception

2014-08-25 Thread Rohit Kumar (JIRA)
Rohit Kumar created SPARK-3203: -- Summary: ClassNotFound Exception Key: SPARK-3203 URL: https://issues.apache.org/jira/browse/SPARK-3203 Project: Spark Issue Type: Bug Components:

[jira] [Created] (SPARK-3202) Manipulating columns in CSV file or Transpose of Array[Array[String]] RDD

2014-08-25 Thread Hingorani, Vineet (JIRA)
Hingorani, Vineet created SPARK-3202: Summary: Manipulating columns in CSV file or Transpose of Array[Array[String]] RDD Key: SPARK-3202 URL: https://issues.apache.org/jira/browse/SPARK-3202

[jira] [Closed] (SPARK-3202) Manipulating columns in CSV file or Transpose of Array[Array[String]] RDD

2014-08-25 Thread Hingorani, Vineet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hingorani, Vineet closed SPARK-3202. Resolution: Invalid Manipulating columns in CSV file or Transpose of Array[Array[String]]

[jira] [Commented] (SPARK-3202) Manipulating columns in CSV file or Transpose of Array[Array[String]] RDD

2014-08-25 Thread Hingorani, Vineet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109129#comment-14109129 ] Hingorani, Vineet commented on SPARK-3202: -- Thank you Sean for the helping

[jira] [Commented] (SPARK-3202) Manipulating columns in CSV file or Transpose of Array[Array[String]] RDD

2014-08-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109128#comment-14109128 ] Sean Owen commented on SPARK-3202: -- JIRA is not a good place to ask questions -- please

[jira] [Commented] (SPARK-3201) Yarn Client do not support the -X java opts

2014-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109131#comment-14109131 ] Apache Spark commented on SPARK-3201: - User 'hzw19900416' has created a pull request

[jira] [Created] (SPARK-3204) MaxOf would be foldable if both left and right are foldable.

2014-08-25 Thread Takuya Ueshin (JIRA)
Takuya Ueshin created SPARK-3204: Summary: MaxOf would be foldable if both left and right are foldable. Key: SPARK-3204 URL: https://issues.apache.org/jira/browse/SPARK-3204 Project: Spark

[jira] [Updated] (SPARK-3206) Error in PageRank values

2014-08-25 Thread Peter Fontana (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Fontana updated SPARK-3206: - Description: I have found a small example where the PageRank values using run and

[jira] [Updated] (SPARK-3206) Error in PageRank values

2014-08-25 Thread Peter Fontana (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Fontana updated SPARK-3206: - Description: I have found a small example where the PageRank values using run and

[jira] [Updated] (SPARK-3206) Error in PageRank values

2014-08-25 Thread Peter Fontana (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Fontana updated SPARK-3206: - Description: I have found a small example where the PageRank values using run and

[jira] [Updated] (SPARK-3206) Error in PageRank values

2014-08-25 Thread Peter Fontana (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Fontana updated SPARK-3206: - Description: I have found a small example where the PageRank values using run and

[jira] [Commented] (SPARK-2189) Method for removing temp tables created by registerAsTable

2014-08-25 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109378#comment-14109378 ] Michael Armbrust commented on SPARK-2189: - Thanks for offering to work on this.

[jira] [Created] (SPARK-3207) Choose splits for continuous features in DecisionTree more adaptively

2014-08-25 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-3207: Summary: Choose splits for continuous features in DecisionTree more adaptively Key: SPARK-3207 URL: https://issues.apache.org/jira/browse/SPARK-3207 Project:

[jira] [Commented] (SPARK-3147) Implement A/B testing

2014-08-25 Thread Michael Yannakopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109402#comment-14109402 ] Michael Yannakopoulos commented on SPARK-3147: -- Hi Xiangrui, It would be my

[jira] [Commented] (SPARK-3184) Allow user to specify num tasks to use for a table

2014-08-25 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109439#comment-14109439 ] Michael Armbrust commented on SPARK-3184: - Yeah, it looks like is is actually

[jira] [Updated] (SPARK-3184) Allow user to specify num tasks to use for a table

2014-08-25 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3184: Priority: Minor (was: Major) Allow user to specify num tasks to use for a table

[jira] [Created] (SPARK-3208) Hive Parquet SerDe returns null columns

2014-08-25 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-3208: --- Summary: Hive Parquet SerDe returns null columns Key: SPARK-3208 URL: https://issues.apache.org/jira/browse/SPARK-3208 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-3209) bump the version in banner

2014-08-25 Thread Davies Liu (JIRA)
Davies Liu created SPARK-3209: - Summary: bump the version in banner Key: SPARK-3209 URL: https://issues.apache.org/jira/browse/SPARK-3209 Project: Spark Issue Type: Bug Components:

[jira] [Resolved] (SPARK-3140) PySpark start-up throws confusing exception

2014-08-25 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3140. --- Resolution: Fixed Assignee: Andrew Or PySpark start-up throws confusing exception

[jira] [Commented] (SPARK-1764) EOF reached before Python server acknowledged

2014-08-25 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109512#comment-14109512 ] Davies Liu commented on SPARK-1764: --- This issue should be fixed in SPARK-2282 [1], I had

[jira] [Created] (SPARK-3210) Flume Polling Receiver must be more tolerant to connection failures.

2014-08-25 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created SPARK-3210: --- Summary: Flume Polling Receiver must be more tolerant to connection failures. Key: SPARK-3210 URL: https://issues.apache.org/jira/browse/SPARK-3210 Project:

[jira] [Closed] (SPARK-3209) bump the version in banner

2014-08-25 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-3209. - Resolution: Invalid The version number is correct in branch-1.1. bump the version in banner

[jira] [Resolved] (SPARK-2840) Improve documentation for decision tree

2014-08-25 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2840. --- Resolution: Fixed Fix Version/s: 1.1.0 Improve documentation for decision tree

[jira] [Commented] (SPARK-3044) Create RSS feed for Spark News

2014-08-25 Thread Michael Yannakopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109571#comment-14109571 ] Michael Yannakopoulos commented on SPARK-3044: -- Hi Nicholas, I am really

[jira] [Created] (SPARK-3211) .take() is OOM-prone when there are empty partitions

2014-08-25 Thread Andrew Ash (JIRA)
Andrew Ash created SPARK-3211: - Summary: .take() is OOM-prone when there are empty partitions Key: SPARK-3211 URL: https://issues.apache.org/jira/browse/SPARK-3211 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1764) EOF reached before Python server acknowledged

2014-08-25 Thread nigel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109583#comment-14109583 ] nigel commented on SPARK-1764: -- Hi; Sadly I moved jobs and I don't have a working Spark

[jira] [Commented] (SPARK-2087) Clean Multi-user semantics for thrift JDBC/ODBC server.

2014-08-25 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109587#comment-14109587 ] Michael Armbrust commented on SPARK-2087: - You can't make temporary tables yet,

[jira] [Commented] (SPARK-3211) .take() is OOM-prone when there are empty partitions

2014-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109591#comment-14109591 ] Apache Spark commented on SPARK-3211: - User 'ash211' has created a pull request for

[jira] [Commented] (SPARK-3205) input format for text records saved with in-record delimiter and newline characters escaped

2014-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109592#comment-14109592 ] Apache Spark commented on SPARK-3205: - User 'mengxr' has created a pull request for

[jira] [Resolved] (SPARK-2495) Ability to re-create ML models

2014-08-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-2495. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 2112

[jira] [Resolved] (SPARK-2798) Correct several small errors in Flume module pom.xml files

2014-08-25 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-2798. -- Resolution: Fixed Fix Version/s: 1.1.0 Assignee: Sean Owen Correct several

[jira] [Updated] (SPARK-2798) Correct several small errors in Flume module pom.xml files

2014-08-25 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2798: - Affects Version/s: (was: 1.0.1) Correct several small errors in Flume module pom.xml files

[jira] [Commented] (SPARK-2798) Correct several small errors in Flume module pom.xml files

2014-08-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109675#comment-14109675 ] Sean Owen commented on SPARK-2798: -- [~tdas] Cool, I think this closes SPARK-3169 too if I

[jira] [Commented] (SPARK-3044) Create RSS feed for Spark News

2014-08-25 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109677#comment-14109677 ] Nicholas Chammas commented on SPARK-3044: - Hi Michael, I don't know if the site

[jira] [Created] (SPARK-3213) spark_ec2.py cannot find slave instances

2014-08-25 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-3213: Summary: spark_ec2.py cannot find slave instances Key: SPARK-3213 URL: https://issues.apache.org/jira/browse/SPARK-3213 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3213) spark_ec2.py cannot find slave instances

2014-08-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109697#comment-14109697 ] Joseph K. Bradley commented on SPARK-3213: -- [~vidaha] Please take a look.

[jira] [Commented] (SPARK-3213) spark_ec2.py cannot find slave instances

2014-08-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109700#comment-14109700 ] Joseph K. Bradley commented on SPARK-3213: -- The security group name I was using

[jira] [Updated] (SPARK-3156) DecisionTree: Order categorical features adaptively

2014-08-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3156: - Assignee: Joseph K. Bradley DecisionTree: Order categorical features adaptively

[jira] [Resolved] (SPARK-3180) Better control of security groups

2014-08-25 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3180. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 2088

[jira] [Created] (SPARK-3214) Argument parsing loop in make-distribution.sh ends prematurely

2014-08-25 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-3214: - Summary: Argument parsing loop in make-distribution.sh ends prematurely Key: SPARK-3214 URL: https://issues.apache.org/jira/browse/SPARK-3214 Project: Spark

[jira] [Commented] (SPARK-2798) Correct several small errors in Flume module pom.xml files

2014-08-25 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109735#comment-14109735 ] Tathagata Das commented on SPARK-2798: -- Naah, that was already closed by the fix I

[jira] [Commented] (SPARK-3214) Argument parsing loop in make-distribution.sh ends prematurely

2014-08-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109765#comment-14109765 ] Cheng Lian commented on SPARK-3214: --- Didn't realize all Maven options must go after

[jira] [Closed] (SPARK-3214) Argument parsing loop in make-distribution.sh ends prematurely

2014-08-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian closed SPARK-3214. - Resolution: Not a Problem Argument parsing loop in make-distribution.sh ends prematurely

[jira] [Commented] (SPARK-3213) spark_ec2.py cannot find slave instances

2014-08-25 Thread Vida Ha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109818#comment-14109818 ] Vida Ha commented on SPARK-3213: Joseph, Josh, I discussed in person. There is a quick

[jira] [Comment Edited] (SPARK-3213) spark_ec2.py cannot find slave instances

2014-08-25 Thread Vida Ha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109818#comment-14109818 ] Vida Ha edited comment on SPARK-3213 at 8/25/14 9:57 PM: - Joseph,

[jira] [Commented] (SPARK-3213) spark_ec2.py cannot find slave instances

2014-08-25 Thread Vida Ha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109828#comment-14109828 ] Vida Ha commented on SPARK-3213: Can someone rename this issue to: spark_ec2.py cannot

[jira] [Updated] (SPARK-3213) spark_ec2.py cannot find slave instances launched with Launch More Like This

2014-08-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-3213: - Summary: spark_ec2.py cannot find slave instances launched with Launch More Like This

[jira] [Created] (SPARK-3215) Add remote interface for SparkContext

2014-08-25 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-3215: - Summary: Add remote interface for SparkContext Key: SPARK-3215 URL: https://issues.apache.org/jira/browse/SPARK-3215 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-3215) Add remote interface for SparkContext

2014-08-25 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-3215: -- Attachment: RemoteSparkContext.pdf Initial proposal for a remote context interface. Note that

[jira] [Created] (SPARK-3216) Spark-shell is broken for branch-1.0

2014-08-25 Thread Andrew Or (JIRA)
Andrew Or created SPARK-3216: Summary: Spark-shell is broken for branch-1.0 Key: SPARK-3216 URL: https://issues.apache.org/jira/browse/SPARK-3216 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build

2014-08-25 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-3217: - Summary: Shaded Guava jar doesn't play well with Maven build Key: SPARK-3217 URL: https://issues.apache.org/jira/browse/SPARK-3217 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3216) Spark-shell is broken for branch-1.0

2014-08-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109947#comment-14109947 ] Apache Spark commented on SPARK-3216: - User 'andrewor14' has created a pull request

[jira] [Updated] (SPARK-3189) Add Robust Regression Algorithm with Turkey bisquare weight function (Biweight Estimates)

2014-08-25 Thread Fan Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fan Jiang updated SPARK-3189: - Issue Type: Sub-task (was: New Feature) Parent: SPARK-3188 Add Robust Regression Algorithm

[jira] [Updated] (SPARK-3216) Spark-shell is broken for branch-1.0

2014-08-25 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3216: - Description: This fails when EC2 tries to clone the most recent version of Spark from branch-1.0. This

[jira] [Updated] (SPARK-3216) Spark-shell is broken for branch-1.0

2014-08-25 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3216: - Description: This fails when EC2 tries to clone the most recent version of Spark from branch-1.0. I

[jira] [Updated] (SPARK-3188) Add Robust Regression Algorithm with Tukey bisquare weight function (Biweight Estimates)

2014-08-25 Thread Fan Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fan Jiang updated SPARK-3188: - Summary: Add Robust Regression Algorithm with Tukey bisquare weight function (Biweight Estimates)

[jira] [Updated] (SPARK-3188) Add Robust Regression Algorithm with Tukey bisquare weight function (Biweight Estimates)

2014-08-25 Thread Fan Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fan Jiang updated SPARK-3188: - Description: Linear least square estimates assume the error has normal distribution and can behave

[jira] [Resolved] (SPARK-3204) MaxOf would be foldable if both left and right are foldable.

2014-08-25 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3204. - Resolution: Fixed Fix Version/s: 1.1.0 Assignee: Takuya Ueshin MaxOf

[jira] [Resolved] (SPARK-2929) Rewrite HiveThriftServer2Suite and CliSuite

2014-08-25 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2929. - Resolution: Fixed Fix Version/s: 1.1.0 Rewrite HiveThriftServer2Suite and

[jira] [Commented] (SPARK-3179) Add task OutputMetrics

2014-08-25 Thread Michael Yannakopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109997#comment-14109997 ] Michael Yannakopoulos commented on SPARK-3179: -- Hi Sandy, I am willing to

[jira] [Updated] (SPARK-3061) Maven build fails in Windows OS

2014-08-25 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-3061: -- Affects Version/s: 1.1.0 Maybe we can use a Maven plugin to unzip?

[jira] [Commented] (SPARK-2087) Clean Multi-user semantics for thrift JDBC/ODBC server.

2014-08-25 Thread Yi Tian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110026#comment-14110026 ] Yi Tian commented on SPARK-2087: You mean the CACHE TABLE ... AS SELECT... syntax will

[jira] [Commented] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build

2014-08-25 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110035#comment-14110035 ] Marcelo Vanzin commented on SPARK-3217: --- Just did a git clean -dfx on master and

[jira] [Updated] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build

2014-08-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3217: -- Affects Version/s: (was: 1.0.2) Shaded Guava jar doesn't play well with Maven build

[jira] [Updated] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build

2014-08-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3217: -- Labels: 1.2.0 (was: ) Shaded Guava jar doesn't play well with Maven build

[jira] [Updated] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build

2014-08-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3217: -- Target Version/s: 1.2.0 (was: 1.1.0) Shaded Guava jar doesn't play well with Maven build

[jira] [Resolved] (SPARK-3058) Support EXTENDED for EXPLAIN command

2014-08-25 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3058. - Resolution: Fixed Fix Version/s: 1.1.0 Support EXTENDED for EXPLAIN command

[jira] [Updated] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build

2014-08-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3217: --- Labels: (was: 1.2.0) Shaded Guava jar doesn't play well with Maven build

[jira] [Updated] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build

2014-08-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3217: --- Affects Version/s: 1.2.0 Shaded Guava jar doesn't play well with Maven build

[jira] [Commented] (SPARK-3178) setting SPARK_WORKER_MEMORY to a value without a label (m or g) sets the worker memory limit to zero

2014-08-25 Thread Helena Edelson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110116#comment-14110116 ] Helena Edelson commented on SPARK-3178: --- +1 it doesn't look like the input data is

[jira] [Created] (SPARK-3218) K-Means clusterer can fail on degenerate data

2014-08-25 Thread Derrick Burns (JIRA)
Derrick Burns created SPARK-3218: Summary: K-Means clusterer can fail on degenerate data Key: SPARK-3218 URL: https://issues.apache.org/jira/browse/SPARK-3218 Project: Spark Issue Type: Bug

[jira] [Reopened] (SPARK-3193) output errer info when Process exitcode not zero

2014-08-25 Thread wangfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangfei reopened SPARK-3193: output errer info when Process exitcode not zero

[jira] [Commented] (SPARK-2921) Mesos doesn't handle spark.executor.extraJavaOptions correctly (among other things)

2014-08-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110127#comment-14110127 ] Cheng Lian commented on SPARK-2921: --- [~andrewor14] {{spark.executor.extraLibraryPath}}

[jira] [Created] (SPARK-3219) K-Means clusterer should support Bregman distance metrics

2014-08-25 Thread Derrick Burns (JIRA)
Derrick Burns created SPARK-3219: Summary: K-Means clusterer should support Bregman distance metrics Key: SPARK-3219 URL: https://issues.apache.org/jira/browse/SPARK-3219 Project: Spark

[jira] [Created] (SPARK-3220) K-Means clusterer should perform K-Means initialization in parallel

2014-08-25 Thread Derrick Burns (JIRA)
Derrick Burns created SPARK-3220: Summary: K-Means clusterer should perform K-Means initialization in parallel Key: SPARK-3220 URL: https://issues.apache.org/jira/browse/SPARK-3220 Project: Spark

[jira] [Commented] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build

2014-08-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110142#comment-14110142 ] Cheng Lian commented on SPARK-3217: --- [~vanzin] Thanks, I did set

[jira] [Comment Edited] (SPARK-3213) spark_ec2.py cannot find slave instances launched with Launch More Like This

2014-08-25 Thread Vida Ha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110149#comment-14110149 ] Vida Ha edited comment on SPARK-3213 at 8/26/14 1:49 AM: - Hi

[jira] [Commented] (SPARK-3213) spark_ec2.py cannot find slave instances launched with Launch More Like This

2014-08-25 Thread Vida Ha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110149#comment-14110149 ] Vida Ha commented on SPARK-3213: Hi Joseph, Can you tell me more about how you launched

[jira] [Updated] (SPARK-3213) spark_ec2.py cannot find slave instances launched with Launch More Like This

2014-08-25 Thread Vida Ha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vida Ha updated SPARK-3213: --- Attachment: Screen Shot 2014-08-25 at 6.45.35 PM.png spark_ec2.py cannot find slave instances launched with

[jira] [Comment Edited] (SPARK-3213) spark_ec2.py cannot find slave instances launched with Launch More Like This

2014-08-25 Thread Vida Ha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110149#comment-14110149 ] Vida Ha edited comment on SPARK-3213 at 8/26/14 1:51 AM: - Hi

  1   2   >