[jira] [Assigned] (SPARK-12881) Enable sub-expression Elimination in generated mutable projection

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12881: Assignee: Apache Spark (was: Davies Liu) > Enable sub-expression Elimination in generated

[jira] [Assigned] (SPARK-12881) Enable sub-expression Elimination in generated mutable projection

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12881: Assignee: Davies Liu (was: Apache Spark) > Enable sub-expression Elimination in generated

[jira] [Resolved] (SPARK-12346) GLM summary crashes with NoSuchElementException if attributes are missing names

2016-01-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-12346. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Commented] (SPARK-12881) Enable sub-expression Elimination in generated mutable projection

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105818#comment-15105818 ] Apache Spark commented on SPARK-12881: -- User 'davies' has created a pull request for

[jira] [Updated] (SPARK-12346) GLM summary crashes with NoSuchElementException if attributes are missing names

2016-01-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12346: -- Assignee: Eric Liang > GLM summary crashes with NoSuchElementException if attributes are missin

[jira] [Updated] (SPARK-12346) GLM summary crashes with NoSuchElementException if attributes are missing names

2016-01-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12346: -- Target Version/s: 1.6.1, 2.0.0 (was: 2.0.0) > GLM summary crashes with NoSuchElementException

[jira] [Updated] (SPARK-12299) Remove history serving functionality from standalone Master

2016-01-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12299: --- Assignee: (was: Josh Rosen) > Remove history serving functionality from standalone Master > -

[jira] [Created] (SPARK-12884) Move *Metrics and *Accum* classes to their own files

2016-01-18 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12884: - Summary: Move *Metrics and *Accum* classes to their own files Key: SPARK-12884 URL: https://issues.apache.org/jira/browse/SPARK-12884 Project: Spark Issue Type: Su

[jira] [Commented] (SPARK-12299) Remove history serving functionality from standalone Master

2016-01-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105817#comment-15105817 ] Josh Rosen commented on SPARK-12299: I'm not actively working on this, so this is up-

[jira] [Updated] (SPARK-12346) GLM summary crashes with NoSuchElementException if attributes are missing names

2016-01-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12346: -- Target Version/s: 2.0.0 > GLM summary crashes with NoSuchElementException if attributes are mis

[jira] [Commented] (SPARK-10975) Shuffle files left behind on Mesos without dynamic allocation

2016-01-18 Thread Fede Bar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105809#comment-15105809 ] Fede Bar commented on SPARK-10975: -- Hi Sean, yes agreed, I believe it can be marked dupl

[jira] [Commented] (SPARK-12786) Actor demo does not demonstrate usable code

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105802#comment-15105802 ] Apache Spark commented on SPARK-12786: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-12786) Actor demo does not demonstrate usable code

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12786: Assignee: Apache Spark > Actor demo does not demonstrate usable code > ---

[jira] [Assigned] (SPARK-12786) Actor demo does not demonstrate usable code

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12786: Assignee: (was: Apache Spark) > Actor demo does not demonstrate usable code >

[jira] [Updated] (SPARK-12883) 1.6 Dynamic allocation doc still refers to 1.2

2016-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12883: -- Priority: Trivial (was: Minor) [~manojsamel] this isn't really worth a JIRA if it's that trivial a cha

[jira] [Assigned] (SPARK-12882) simplify bucket tests and add more comments

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12882: Assignee: Apache Spark > simplify bucket tests and add more comments > ---

[jira] [Commented] (SPARK-12882) simplify bucket tests and add more comments

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105793#comment-15105793 ] Apache Spark commented on SPARK-12882: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-12882) simplify bucket tests and add more comments

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12882: Assignee: (was: Apache Spark) > simplify bucket tests and add more comments >

[jira] [Created] (SPARK-12883) 1.6 Dynamic allocation doc still refers to 1.2

2016-01-18 Thread Manoj Samel (JIRA)
Manoj Samel created SPARK-12883: --- Summary: 1.6 Dynamic allocation doc still refers to 1.2 Key: SPARK-12883 URL: https://issues.apache.org/jira/browse/SPARK-12883 Project: Spark Issue Type: Docu

[jira] [Commented] (SPARK-10975) Shuffle files left behind on Mesos without dynamic allocation

2016-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105778#comment-15105778 ] Sean Owen commented on SPARK-10975: --- OK, then it's a duplicate of SPARK-12430, no? > S

[jira] [Created] (SPARK-12882) simplify bucket tests and add more comments

2016-01-18 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-12882: --- Summary: simplify bucket tests and add more comments Key: SPARK-12882 URL: https://issues.apache.org/jira/browse/SPARK-12882 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-01-18 Thread Daniel Siegmann (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105772#comment-15105772 ] Daniel Siegmann commented on SPARK-4105: I had this happen in Spark 1.5.0. It only

[jira] [Commented] (SPARK-10975) Shuffle files left behind on Mesos without dynamic allocation

2016-01-18 Thread Fede Bar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105769#comment-15105769 ] Fede Bar commented on SPARK-10975: -- Hi, this issue is not quite resolved actually, pleas

[jira] [Created] (SPARK-12881) Enable sub-expression Elimination in generated mutable projection

2016-01-18 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12881: -- Summary: Enable sub-expression Elimination in generated mutable projection Key: SPARK-12881 URL: https://issues.apache.org/jira/browse/SPARK-12881 Project: Spark

[jira] [Commented] (SPARK-12880) Different results on groupBy after window function

2016-01-18 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105751#comment-15105751 ] Herman van Hovell commented on SPARK-12880: --- No Problem. You don't have to dele

[jira] [Closed] (SPARK-12880) Different results on groupBy after window function

2016-01-18 Thread Saif Addin Ellafi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saif Addin Ellafi closed SPARK-12880. - Resolution: Not A Problem > Different results on groupBy after window function >

[jira] [Commented] (SPARK-12880) Different results on groupBy after window function

2016-01-18 Thread Saif Addin Ellafi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105748#comment-15105748 ] Saif Addin Ellafi commented on SPARK-12880: --- Thank you, I think what you mentio

[jira] [Commented] (SPARK-12867) Nullability of Intersect can be stricter

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105725#comment-15105725 ] Apache Spark commented on SPARK-12867: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-12867) Nullability of Intersect can be stricter

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12867: Assignee: Apache Spark (was: Xiao Li) > Nullability of Intersect can be stricter > --

[jira] [Assigned] (SPARK-12867) Nullability of Intersect can be stricter

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12867: Assignee: Xiao Li (was: Apache Spark) > Nullability of Intersect can be stricter > --

[jira] [Resolved] (SPARK-12873) Add more comment in HiveTypeCoercion for type widening

2016-01-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12873. - Resolution: Fixed Fix Version/s: 2.0.0 > Add more comment in HiveTypeCoercion for type wid

[jira] [Commented] (SPARK-12880) Different results on groupBy after window function

2016-01-18 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105678#comment-15105678 ] Herman van Hovell commented on SPARK-12880: --- You are ordering by {{MM}} and

[jira] [Updated] (SPARK-12880) Different results on groupBy after window function

2016-01-18 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-12880: -- Priority: Major (was: Critical) > Different results on groupBy after window function >

[jira] [Updated] (SPARK-12880) Different results on groupBy after window function

2016-01-18 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-12880: -- Description: {noformat} scala> val overVint = Window.partitionBy("product", "bnd", "ag

[jira] [Comment Edited] (SPARK-12864) initialize executorIdCounter after ApplicationMaster killed for max number of executor failures reached

2016-01-18 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105671#comment-15105671 ] Saisai Shao edited comment on SPARK-12864 at 1/18/16 7:03 PM: -

[jira] [Commented] (SPARK-12864) initialize executorIdCounter after ApplicationMaster killed for max number of executor failures reached

2016-01-18 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105671#comment-15105671 ] Saisai Shao commented on SPARK-12864: - What's Spark version are you using? I remember

[jira] [Updated] (SPARK-12880) Different results on groupBy after window function

2016-01-18 Thread Saif Addin Ellafi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saif Addin Ellafi updated SPARK-12880: -- Description: scala> val overVint = Window.partitionBy("product", "bnd", "age").orderBy

[jira] [Created] (SPARK-12880) Different results on groupBy after window function

2016-01-18 Thread Saif Addin Ellafi (JIRA)
Saif Addin Ellafi created SPARK-12880: - Summary: Different results on groupBy after window function Key: SPARK-12880 URL: https://issues.apache.org/jira/browse/SPARK-12880 Project: Spark

[jira] [Commented] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105643#comment-15105643 ] Apache Spark commented on SPARK-10620: -- User 'andrewor14' has created a pull request

[jira] [Commented] (SPARK-12867) Nullability of Intersect can be stricter

2016-01-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105622#comment-15105622 ] Xiao Li commented on SPARK-12867: - Thank you! > Nullability of Intersect can be stricte

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

2016-01-18 Thread Gabor Feher (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105621#comment-15105621 ] Gabor Feher commented on SPARK-3630: Hi, I've run into this problem as well. {code}

[jira] [Commented] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105619#comment-15105619 ] Apache Spark commented on SPARK-10620: -- User 'andrewor14' has created a pull request

[jira] [Updated] (SPARK-12867) Nullability of Intersect can be stricter

2016-01-18 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12867: --- Assignee: Xiao Li > Nullability of Intersect can be stricter > --

[jira] [Commented] (SPARK-12867) Nullability of Intersect can be stricter

2016-01-18 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105616#comment-15105616 ] Cheng Lian commented on SPARK-12867: Thanks for helping! Go ahead, please. I'm assign

[jira] [Assigned] (SPARK-12879) improve unsafe row writing framework

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12879: Assignee: Apache Spark > improve unsafe row writing framework > --

[jira] [Assigned] (SPARK-12879) improve unsafe row writing framework

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12879: Assignee: (was: Apache Spark) > improve unsafe row writing framework > ---

[jira] [Commented] (SPARK-12879) improve unsafe row writing framework

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105608#comment-15105608 ] Apache Spark commented on SPARK-12879: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-12879) improve unsafe row writing framework

2016-01-18 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-12879: --- Summary: improve unsafe row writing framework Key: SPARK-12879 URL: https://issues.apache.org/jira/browse/SPARK-12879 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-11139) Make SparkContext.stop() exception-safe

2016-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11139. --- Resolution: Duplicate OK then this one is the duplicate > Make SparkContext.stop() exception-safe >

[jira] [Commented] (SPARK-9976) create function do not work

2016-01-18 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105570#comment-15105570 ] Yin Huai commented on SPARK-9976: - what version of spark are you using? Also, what is the

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2016-01-18 Thread Mario Briggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105560#comment-15105560 ] Mario Briggs commented on SPARK-12177: -- Hi Nikita, great. 1 - We should also hav

[jira] [Assigned] (SPARK-11714) Make Spark on Mesos honor port restrictions

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11714: Assignee: (was: Apache Spark) > Make Spark on Mesos honor port restrictions >

[jira] [Assigned] (SPARK-11714) Make Spark on Mesos honor port restrictions

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11714: Assignee: Apache Spark > Make Spark on Mesos honor port restrictions > ---

[jira] [Commented] (SPARK-11714) Make Spark on Mesos honor port restrictions

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105554#comment-15105554 ] Apache Spark commented on SPARK-11714: -- User 'skonto' has created a pull request for

[jira] [Assigned] (SPARK-11137) Make StreamingContext.stop() exception-safe

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11137: Assignee: Apache Spark > Make StreamingContext.stop() exception-safe > ---

[jira] [Commented] (SPARK-11137) Make StreamingContext.stop() exception-safe

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105524#comment-15105524 ] Apache Spark commented on SPARK-11137: -- User 'jayadevanmurali' has created a pull re

[jira] [Assigned] (SPARK-11137) Make StreamingContext.stop() exception-safe

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11137: Assignee: (was: Apache Spark) > Make StreamingContext.stop() exception-safe >

[jira] [Commented] (SPARK-11137) Make StreamingContext.stop() exception-safe

2016-01-18 Thread Jayadevan M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105523#comment-15105523 ] Jayadevan M commented on SPARK-11137: - [~thomastechs] working on the fix > Make Stre

[jira] [Commented] (SPARK-11139) Make SparkContext.stop() exception-safe

2016-01-18 Thread Thomas Sebastian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105519#comment-15105519 ] Thomas Sebastian commented on SPARK-11139: -- I have re-opened the issue SPARK-11

[jira] [Reopened] (SPARK-11137) Make StreamingContext.stop() exception-safe

2016-01-18 Thread Thomas Sebastian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Sebastian reopened SPARK-11137: -- Re-opening this issue based on the discussion at https://issues.apache.org/jira/browse/SPA

[jira] [Commented] (SPARK-11560) Optimize KMeans implementation

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105427#comment-15105427 ] Apache Spark commented on SPARK-11560: -- User 'yanboliang' has created a pull request

[jira] [Commented] (SPARK-8519) Blockify distance computation in k-means

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105426#comment-15105426 ] Apache Spark commented on SPARK-8519: - User 'yanboliang' has created a pull request fo

[jira] [Commented] (SPARK-11559) Make `runs` no effect in k-means

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105428#comment-15105428 ] Apache Spark commented on SPARK-11559: -- User 'yanboliang' has created a pull request

[jira] [Updated] (SPARK-12878) Dataframe fails with nested User Defined Types

2016-01-18 Thread Joao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao updated SPARK-12878: - Description: Spark 1.6.0 crashes when using nested User Defined Types in a Dataframe. In version 1.5.2 the code

[jira] [Commented] (SPARK-11559) Make `runs` no effect in k-means

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105380#comment-15105380 ] Apache Spark commented on SPARK-11559: -- User 'yanboliang' has created a pull request

[jira] [Commented] (SPARK-11560) Optimize KMeans implementation

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105379#comment-15105379 ] Apache Spark commented on SPARK-11560: -- User 'yanboliang' has created a pull request

[jira] [Commented] (SPARK-8519) Blockify distance computation in k-means

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105378#comment-15105378 ] Apache Spark commented on SPARK-8519: - User 'yanboliang' has created a pull request fo

[jira] [Created] (SPARK-12878) Dataframe fails with nested User Defined Types

2016-01-18 Thread Joao (JIRA)
Joao created SPARK-12878: Summary: Dataframe fails with nested User Defined Types Key: SPARK-12878 URL: https://issues.apache.org/jira/browse/SPARK-12878 Project: Spark Issue Type: Bug Comp

[jira] [Issue Comment Deleted] (SPARK-11518) The script spark-submit.cmd can not handle spark directory with space.

2016-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11518: -- Comment: was deleted (was: No. I just use work around to not put Spark into a such folder.) > The scri

[jira] [Issue Comment Deleted] (SPARK-11518) The script spark-submit.cmd can not handle spark directory with space.

2016-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11518: -- Comment: was deleted (was: No. I just use work around to not put Spark into a such folder.) > The scri

[jira] [Resolved] (SPARK-3872) Rewrite the test for ActorInputStream.

2016-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3872. -- Resolution: Won't Fix > Rewrite the test for ActorInputStream. > --

[jira] [Resolved] (SPARK-3437) Adapt maven build to work without the need of hardcoding scala binary version in artifact id.

2016-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3437. -- Resolution: Won't Fix > Adapt maven build to work without the need of hardcoding scala binary version >

[jira] [Resolved] (SPARK-3107) Don't pass null jar to executor in yarn-client mode

2016-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3107. -- Resolution: Duplicate I think the result was that this was resolved, narrowly, by SPARK-2933 > Don't pa

[jira] [Resolved] (SPARK-2703) Make Tachyon related unit tests execute without deploying a Tachyon system locally.

2016-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2703. -- Resolution: Won't Fix Assignee: (was: Rong Gu) > Make Tachyon related unit tests execute witho

[jira] [Resolved] (SPARK-2653) Heap size should be the sum of driver.memory and executor.memory in local mode

2016-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2653. -- Resolution: Not A Problem Although I don't feel so strongly about this either way, it would be a behavio

[jira] [Updated] (SPARK-2153) CassandraTest fails for newer Cassandra due to case insensitive key space

2016-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2153: - Labels: (was: examples) Issue Type: Improvement (was: Bug) [~vishnusubramanian] would this be r

[jira] [Resolved] (SPARK-1529) Support DFS based shuffle in addition to Netty shuffle

2016-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1529. -- Resolution: Won't Fix > Support DFS based shuffle in addition to Netty shuffle > ---

[jira] [Resolved] (SPARK-1169) Add countApproxDistinctByKey to PySpark

2016-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1169. -- Resolution: Won't Fix > Add countApproxDistinctByKey to PySpark > --

[jira] [Resolved] (SPARK-10264) Add @Since annotation to ml.recoomendation

2016-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10264. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10756 [https://github.co

[jira] [Comment Edited] (SPARK-12863) missing api for renaming and mapping result of operations on GroupedDataset to case classes

2016-01-18 Thread Milad Khajavi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105262#comment-15105262 ] Milad Khajavi edited comment on SPARK-12863 at 1/18/16 1:18 PM: ---

[jira] [Commented] (SPARK-12863) missing api for renaming and mapping result of operations on GroupedDataset to case classes

2016-01-18 Thread Milad Khajavi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105262#comment-15105262 ] Milad Khajavi commented on SPARK-12863: --- I'm doing it with Dataframe api, but Datas

[jira] [Updated] (SPARK-12823) Cannot create UDF with StructType input

2016-01-18 Thread Frank Rosner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Rosner updated SPARK-12823: - Description: h5. Problem It is not possible to apply a UDF to a column that has a struct data ty

[jira] [Updated] (SPARK-12823) Cannot create UDF with StructType input

2016-01-18 Thread Frank Rosner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Rosner updated SPARK-12823: - Description: h5. Problem It is not possible to apply a UDF to a column that has a struct data ty

[jira] [Updated] (SPARK-12823) Cannot create UDF with StructType input

2016-01-18 Thread Frank Rosner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Rosner updated SPARK-12823: - Description: h5. Problem It is not possible to apply a UDF to a column that has a struct data ty

[jira] [Updated] (SPARK-12823) Cannot create UDF with StructType input

2016-01-18 Thread Frank Rosner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Rosner updated SPARK-12823: - Description: h5. Problem It is not possible to apply a UDF to a column that has a struct data ty

[jira] [Created] (SPARK-12877) TrainValidationSplit is missing in pyspark.ml.tuning

2016-01-18 Thread Wojciech Jurczyk (JIRA)
Wojciech Jurczyk created SPARK-12877: Summary: TrainValidationSplit is missing in pyspark.ml.tuning Key: SPARK-12877 URL: https://issues.apache.org/jira/browse/SPARK-12877 Project: Spark

[jira] [Closed] (SPARK-12863) missing api for renaming and mapping result of operations on GroupedDataset to case classes

2016-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-12863. - > missing api for renaming and mapping result of operations on GroupedDataset > to case classes > --

[jira] [Resolved] (SPARK-12863) missing api for renaming and mapping result of operations on GroupedDataset to case classes

2016-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12863. --- Resolution: Not A Problem You haven't proposed an API; you're asking how to do something, which can

[jira] [Updated] (SPARK-12876) Race condition when driver rapidly shutdown after started.

2016-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12876: -- Priority: Minor (was: Major) How do you reproduce it? > Race condition when driver rapidly shutdown a

[jira] [Commented] (SPARK-11948) Permanent UDF not work

2016-01-18 Thread ocean (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105170#comment-15105170 ] ocean commented on SPARK-11948: --- Does sparksql support temporary udf function which extend

[jira] [Commented] (SPARK-9976) create function do not work

2016-01-18 Thread ocean (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105168#comment-15105168 ] ocean commented on SPARK-9976: -- Does sparksql support temporary udf function which extends u

[jira] [Updated] (SPARK-12876) Race condition when driver rapidly shutdown after started.

2016-01-18 Thread jeffonia Tung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeffonia Tung updated SPARK-12876: -- Description: It's a little same as the issue: SPARK-4300. Well, this time, it's happen on the

[jira] [Reopened] (SPARK-12863) missing api for renaming and mapping result of operations on GroupedDataset to case classes

2016-01-18 Thread Milad Khajavi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milad Khajavi reopened SPARK-12863: --- I have no question. The spark 1.6.0 have missing api for this problem. > missing api for renamin

[jira] [Updated] (SPARK-12876) Race condition when driver rapidly shutdown after started.

2016-01-18 Thread jeffonia Tung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeffonia Tung updated SPARK-12876: -- Description: It's a little same as the issue: SPARK-4300. Well, this time, it's happen on the

[jira] [Updated] (SPARK-12876) Race condition when driver rapidly shutdown after started.

2016-01-18 Thread jeffonia Tung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeffonia Tung updated SPARK-12876: -- Description: It's a little same as the issue: SPARK-4300. Well, this time, it's happen on the

[jira] [Updated] (SPARK-12876) Race condition when driver rapidly shutdown after started.

2016-01-18 Thread jeffonia Tung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeffonia Tung updated SPARK-12876: -- Description: It's a little same as the issue: SPARK-4300. Well, this time, it's happen on the

[jira] [Updated] (SPARK-12876) Race condition when driver rapidly shutdown after started.

2016-01-18 Thread jeffonia Tung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeffonia Tung updated SPARK-12876: -- Description: It's a little same as the issue: SPARK-4300 [INFO 2016-01-18 17:12:35 (Logging.sc

[jira] [Created] (SPARK-12876) Race condition when driver rapidly shutdown after started.

2016-01-18 Thread jeffonia Tung (JIRA)
jeffonia Tung created SPARK-12876: - Summary: Race condition when driver rapidly shutdown after started. Key: SPARK-12876 URL: https://issues.apache.org/jira/browse/SPARK-12876 Project: Spark

[jira] [Commented] (SPARK-12871) Support to specify the option for compression codec.

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105086#comment-15105086 ] Apache Spark commented on SPARK-12871: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-12871) Support to specify the option for compression codec.

2016-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12871: Assignee: (was: Apache Spark) > Support to specify the option for compression codec. >

<    1   2   3   >