[jira] [Assigned] (SPARK-12710) Create local CoGroup operator

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12710: Assignee: (was: Apache Spark) > Create local CoGroup operator >

[jira] [Commented] (SPARK-12710) Create local CoGroup operator

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088857#comment-15088857 ] Apache Spark commented on SPARK-12710: -- User 'mwws' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12710) Create local CoGroup operator

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12710: Assignee: Apache Spark > Create local CoGroup operator > - >

[jira] [Commented] (SPARK-1270) An optimized gradient descent implementation

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088869#comment-15088869 ] Apache Spark commented on SPARK-1270: - User 'yoshidakuy' has created a pull request for this issue:

[jira] [Commented] (SPARK-12708) Sorting task error in Stages Page when yarn mode

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088898#comment-15088898 ] Apache Spark commented on SPARK-12708: -- User 'yoshidakuy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12708) Sorting task error in Stages Page when yarn mode

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12708: Assignee: Apache Spark > Sorting task error in Stages Page when yarn mode >

[jira] [Assigned] (SPARK-12708) Sorting task error in Stages Page when yarn mode

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12708: Assignee: (was: Apache Spark) > Sorting task error in Stages Page when yarn mode >

[jira] [Resolved] (SPARK-12692) Scala style: check no white space before comma and colon

2016-01-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12692. - Resolution: Fixed Assignee: Kousuke Saruta Fix Version/s: 2.0.0 > Scala style:

[jira] [Reopened] (SPARK-12692) Scala style: check no white space before comma and colon

2016-01-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reopened SPARK-12692: - Reopen this since we still need to fix the violations. > Scala style: check no white space before

[jira] [Assigned] (SPARK-12692) Scala style: check no white space before comma and colon

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12692: Assignee: Kousuke Saruta (was: Apache Spark) > Scala style: check no white space before

[jira] [Assigned] (SPARK-12692) Scala style: check no white space before comma and colon

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12692: Assignee: Apache Spark (was: Kousuke Saruta) > Scala style: check no white space before

[jira] [Closed] (SPARK-11214) Join with Unicode-String results wrong empty

2016-01-08 Thread Hans Fischer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hans Fischer closed SPARK-11214. Resolution: Fixed Update: The problem only occur when you require a lot of ram. 30g or less will

[jira] [Commented] (SPARK-12622) spark-submit fails on executors when jar has a space in it

2016-01-08 Thread Ajesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088933#comment-15088933 ] Ajesh Kumar commented on SPARK-12622: - Can you provide the steps to recreate the issue? >

[jira] [Commented] (SPARK-12675) Executor dies because of ClassCastException and causes timeout

2016-01-08 Thread Alexandru Rosianu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088949#comment-15088949 ] Alexandru Rosianu commented on SPARK-12675: --- I'd like to add that this doesn't happen in

[jira] [Assigned] (SPARK-12709) Create local Except operator

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12709: Assignee: (was: Apache Spark) > Create local Except operator >

[jira] [Commented] (SPARK-12709) Create local Except operator

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088853#comment-15088853 ] Apache Spark commented on SPARK-12709: -- User 'mwws' has created a pull request for this issue:

[jira] [Commented] (SPARK-12621) ArrayIndexOutOfBoundsException when running sqlContext.sql(...)

2016-01-08 Thread Lei Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088863#comment-15088863 ] Lei Wu commented on SPARK-12621: Could you elaborate what's your context before you make this SQL query

[jira] [Assigned] (SPARK-1270) An optimized gradient descent implementation

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1270: --- Assignee: Apache Spark > An optimized gradient descent implementation >

[jira] [Assigned] (SPARK-1270) An optimized gradient descent implementation

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1270: --- Assignee: (was: Apache Spark) > An optimized gradient descent implementation >

[jira] [Commented] (SPARK-3893) declare mutableMap/mutableSet explicitly

2016-01-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1507#comment-1507 ] Reynold Xin commented on SPARK-3893: I'm going to close this as won't fix for now since I don't think

[jira] [Closed] (SPARK-3893) declare mutableMap/mutableSet explicitly

2016-01-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-3893. -- Resolution: Won't Fix > declare mutableMap/mutableSet explicitly >

[jira] [Commented] (SPARK-10386) Model import/export for PrefixSpan

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088912#comment-15088912 ] Apache Spark commented on SPARK-10386: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10386) Model import/export for PrefixSpan

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10386: Assignee: Apache Spark > Model import/export for PrefixSpan >

[jira] [Assigned] (SPARK-10386) Model import/export for PrefixSpan

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10386: Assignee: (was: Apache Spark) > Model import/export for PrefixSpan >

[jira] [Commented] (SPARK-12621) ArrayIndexOutOfBoundsException when running sqlContext.sql(...)

2016-01-08 Thread Sasi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088917#comment-15088917 ] Sasi commented on SPARK-12621: -- I run this from my application which act like a driver in JBoss web

[jira] [Assigned] (SPARK-12709) Create local Except operator

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12709: Assignee: Apache Spark > Create local Except operator > > >

[jira] [Commented] (SPARK-12650) No means to specify Xmx settings for SparkSubmit in yarn-cluster mode

2016-01-08 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089684#comment-15089684 ] Marcelo Vanzin commented on SPARK-12650: {{SparkLauncher}} has a constructor that takes a map of

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2016-01-08 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089750#comment-15089750 ] Mark Grover commented on SPARK-12177: - Thanks for working on this, Nikita. I'd like to help out. Here

[jira] [Resolved] (SPARK-12701) Logging FileAppender should use join to ensure thread is finished

2016-01-08 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12701. -- Resolution: Fixed Assignee: Bryan Cutler Fix Version/s: 2.0.0 > Logging

[jira] [Commented] (SPARK-12713) UI Executor page should keep links around to executors that died

2016-01-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089734#comment-15089734 ] Josh Rosen commented on SPARK-12713: +1; UI improvements for dead executors would be great. An issue

[jira] [Commented] (SPARK-12694) The detailed rest API documentation for each field is missing

2016-01-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089737#comment-15089737 ] Josh Rosen commented on SPARK-12694: +1. Do you want to put together a PR for this? > The detailed

[jira] [Reopened] (SPARK-12697) Allow adding new streams without stopping Spark streaming context

2016-01-08 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reopened SPARK-12697: -- Assignee: (was: Shixiong Zhu) > Allow adding new streams without stopping Spark

[jira] [Updated] (SPARK-12697) Allow adding new streams without stopping Spark streaming context

2016-01-08 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12697: - Fix Version/s: (was: 2.0.0) > Allow adding new streams without stopping Spark streaming

[jira] [Resolved] (SPARK-12687) Support from clause surrounded by `()`

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12687. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10660

[jira] [Commented] (SPARK-12694) The detailed rest API documentation for each field is missing

2016-01-08 Thread Zhuo Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089753#comment-15089753 ] Zhuo Liu commented on SPARK-12694: -- Yes, Josh. I plan to fix this soon after Spark-10873. > The

[jira] [Commented] (SPARK-12648) UDF with Option[Double] throws ClassCastException

2016-01-08 Thread kevin yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089758#comment-15089758 ] kevin yu commented on SPARK-12648: -- Hi Mikael: I see, I am looking into to see if it is doable or not.

[jira] [Resolved] (SPARK-12618) Clean up build warnings: 2.0.0 edition

2016-01-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12618. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10570

[jira] [Created] (SPARK-12715) Improve test coverage

2016-01-08 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12715: -- Summary: Improve test coverage Key: SPARK-12715 URL: https://issues.apache.org/jira/browse/SPARK-12715 Project: Spark Issue Type: Sub-task Reporter:

[jira] [Closed] (SPARK-12693) OffsetOutOfRangeException caused by retention

2016-01-08 Thread Rado Buransky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rado Buransky closed SPARK-12693. - Thanks > OffsetOutOfRangeException caused by retention >

[jira] [Resolved] (SPARK-12510) Refactor ActorReceiver to support Java

2016-01-08 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12510. -- Resolution: Fixed Assignee: Shixiong Zhu (was: Apache Spark) Fix Version/s:

[jira] [Resolved] (SPARK-12697) Allow adding new streams without stopping Spark streaming context

2016-01-08 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12697. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0 > Allow adding

[jira] [Commented] (SPARK-12697) Allow adding new streams without stopping Spark streaming context

2016-01-08 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089712#comment-15089712 ] Shixiong Zhu commented on SPARK-12697: -- Sorry, closed a wrong jira > Allow adding new streams

[jira] [Commented] (SPARK-12685) word2vec trainWordsCount gets overflow

2016-01-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089814#comment-15089814 ] Joseph K. Bradley commented on SPARK-12685: --- This affects earlier versions too. Would you mind

[jira] [Updated] (SPARK-12685) word2vec trainWordsCount gets overflow

2016-01-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12685: -- Assignee: yuhao yang > word2vec trainWordsCount gets overflow >

[jira] [Commented] (SPARK-12703) Spark KMeans Documentation Python Api

2016-01-08 Thread Anton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089853#comment-15089853 ] Anton commented on SPARK-12703: --- I'm new with all of this system.. what's a PR? > Spark KMeans

[jira] [Updated] (SPARK-12703) Spark KMeans Documentation Python Api

2016-01-08 Thread Anton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton updated SPARK-12703: -- Description: In the documentation of Spark's Kmeans - Python api:

[jira] [Resolved] (SPARK-12654) sc.wholeTextFiles with spark.hadoop.cloneConf=true fails on secure Hadoop

2016-01-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-12654. --- Resolution: Fixed Assignee: Thomas Graves (was: Apache Spark) > sc.wholeTextFiles

[jira] [Assigned] (SPARK-12654) sc.wholeTextFiles with spark.hadoop.cloneConf=true fails on secure Hadoop

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12654: Assignee: Apache Spark (was: Thomas Graves) > sc.wholeTextFiles with

[jira] [Closed] (SPARK-12654) sc.wholeTextFiles with spark.hadoop.cloneConf=true fails on secure Hadoop

2016-01-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves closed SPARK-12654. - Resolution: Fixed Fix Version/s: 2.0.0 1.6.1 > sc.wholeTextFiles with

[jira] [Reopened] (SPARK-12654) sc.wholeTextFiles with spark.hadoop.cloneConf=true fails on secure Hadoop

2016-01-08 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reopened SPARK-12654: --- > sc.wholeTextFiles with spark.hadoop.cloneConf=true fails on secure Hadoop >

[jira] [Updated] (SPARK-12706) support grouping/grouping_id function together group set

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12706: --- Issue Type: Sub-task (was: New Feature) Parent: SPARK-12540 > support grouping/grouping_id

[jira] [Commented] (SPARK-1832) Executor UI improvement suggestions

2016-01-08 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089909#comment-15089909 ] Alex Bozarth commented on SPARK-1832: - Updated my totals row solution to be independent of the colors

[jira] [Commented] (SPARK-12703) Spark KMeans Documentation Python Api

2016-01-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089844#comment-15089844 ] Joseph K. Bradley commented on SPARK-12703: --- You're right that it shouldn't be computing sqrt.

[jira] [Commented] (SPARK-12713) UI Executor page should keep links around to executors that died

2016-01-08 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089884#comment-15089884 ] Nan Zhu commented on SPARK-12713: - I attached a PR and two duplicate JIRAs which are addressing the same

[jira] [Assigned] (SPARK-6332) compute calibration curve for binary classifiers

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6332: --- Assignee: Apache Spark > compute calibration curve for binary classifiers >

[jira] [Assigned] (SPARK-6332) compute calibration curve for binary classifiers

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6332: --- Assignee: (was: Apache Spark) > compute calibration curve for binary classifiers >

[jira] [Comment Edited] (SPARK-12703) Spark KMeans Documentation Python Api

2016-01-08 Thread Anton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089853#comment-15089853 ] Anton edited comment on SPARK-12703 at 1/8/16 8:07 PM: --- I'm new in all of this

[jira] [Commented] (SPARK-12711) ML StopWordsRemover does not protect itself from column name duplication

2016-01-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089854#comment-15089854 ] Joseph K. Bradley commented on SPARK-12711: --- You're correct that it should prevent column name

[jira] [Updated] (SPARK-12711) ML StopWordsRemover does not protect itself from column name duplication

2016-01-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12711: -- Target Version/s: 1.6.1, 2.0.0 (was: 1.6.1) > ML StopWordsRemover does not protect

[jira] [Commented] (SPARK-6332) compute calibration curve for binary classifiers

2016-01-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089923#comment-15089923 ] Joseph K. Bradley commented on SPARK-6332: -- [~robert_dodier] I'm sorry we have not been able to

[jira] [Commented] (SPARK-1693) Dependent on multiple versions of servlet-api jars lead to throw an SecurityException when Spark built for hadoop 2.3.0 , 2.4.0

2016-01-08 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089936#comment-15089936 ] Owen O'Malley commented on SPARK-1693: -- Can you explain what the problem is and how to fix it? We are

[jira] [Commented] (SPARK-1693) Dependent on multiple versions of servlet-api jars lead to throw an SecurityException when Spark built for hadoop 2.3.0 , 2.4.0

2016-01-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089945#comment-15089945 ] Sean Owen commented on SPARK-1693: -- As I recall this happens because the official JavaEE servlet API jar

[jira] [Reopened] (SPARK-6332) compute calibration curve for binary classifiers

2016-01-08 Thread Robert Dodier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Dodier reopened SPARK-6332: -- I'm reopening this issue, as I have made a new [PR

[jira] [Commented] (SPARK-6332) compute calibration curve for binary classifiers

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089929#comment-15089929 ] Apache Spark commented on SPARK-6332: - User 'robert-dodier' has created a pull request for this issue:

[jira] [Created] (SPARK-12716) Executor UI improvement suggestions - Totals

2016-01-08 Thread Alex Bozarth (JIRA)
Alex Bozarth created SPARK-12716: Summary: Executor UI improvement suggestions - Totals Key: SPARK-12716 URL: https://issues.apache.org/jira/browse/SPARK-12716 Project: Spark Issue Type:

[jira] [Commented] (SPARK-1832) Executor UI improvement suggestions

2016-01-08 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089967#comment-15089967 ] Alex Bozarth commented on SPARK-1832: - Opened a sub-task for the totals UI half. Unless there is a

[jira] [Resolved] (SPARK-4819) Remove Guava's "Optional" from public API

2016-01-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-4819. Resolution: Fixed Fix Version/s: 2.0.0 > Remove Guava's "Optional" from public API >

[jira] [Updated] (SPARK-12705) Sorting column can't be resolved if it's not in projection

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12705: --- Description: The following query can't be resolved: ``` scala> sqlContext.sql("select sum(a) over

[jira] [Updated] (SPARK-12705) Sorting column can't be resolved if it's not in projection

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12705: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-12540 > Sorting column can't be resolved if

[jira] [Resolved] (SPARK-12593) Convert resolved logical plans back to SQL query strings

2016-01-08 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12593. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10541

[jira] [Created] (SPARK-12717) pyspark broadcast fails when using multiple threads

2016-01-08 Thread Edward Walker (JIRA)
Edward Walker created SPARK-12717: - Summary: pyspark broadcast fails when using multiple threads Key: SPARK-12717 URL: https://issues.apache.org/jira/browse/SPARK-12717 Project: Spark Issue

[jira] [Updated] (SPARK-12717) pyspark broadcast fails when using multiple threads

2016-01-08 Thread Edward Walker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Walker updated SPARK-12717: -- Description: The following multi-threaded program that uses broadcast variables consistently

[jira] [Updated] (SPARK-12717) pyspark broadcast fails when using multiple threads

2016-01-08 Thread Edward Walker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Walker updated SPARK-12717: -- Description: The following multi-threaded program that uses broadcast variables consistently

[jira] [Created] (SPARK-12725) SQL generation suffers from name conficts introduced by some analysis rules

2016-01-08 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12725: -- Summary: SQL generation suffers from name conficts introduced by some analysis rules Key: SPARK-12725 URL: https://issues.apache.org/jira/browse/SPARK-12725 Project:

[jira] [Updated] (SPARK-12723) Comprehensive SQL generation support for expressions

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12723: --- Description: Ensure that all built-in expressions can be mapped to its SQL representation if there

[jira] [Updated] (SPARK-12725) SQL generation suffers from name conficts introduced by some analysis rules

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12725: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > SQL generation suffers from name conficts

[jira] [Updated] (SPARK-12728) Integrate SQL generation feature with native view

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12728: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > Integrate SQL generation feature with native

[jira] [Updated] (SPARK-12727) SQL generation support for distinct aggregation patterns that fit DistinctAggregationRewriter analysis rule

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12727: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > SQL generation support for distinct

[jira] [Created] (SPARK-12731) PySpark docstring cleanup

2016-01-08 Thread holdenk (JIRA)
holdenk created SPARK-12731: --- Summary: PySpark docstring cleanup Key: SPARK-12731 URL: https://issues.apache.org/jira/browse/SPARK-12731 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-12716) Executor UI improvement suggestions - Totals

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090245#comment-15090245 ] Apache Spark commented on SPARK-12716: -- User 'ajbozarth' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12716) Executor UI improvement suggestions - Totals

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12716: Assignee: (was: Apache Spark) > Executor UI improvement suggestions - Totals >

[jira] [Assigned] (SPARK-12716) Executor UI improvement suggestions - Totals

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12716: Assignee: Apache Spark > Executor UI improvement suggestions - Totals >

[jira] [Commented] (SPARK-12731) PySpark docstring cleanup

2016-01-08 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090280#comment-15090280 ] holdenk commented on SPARK-12731: - I've got a shell script started to do this I'll just take some free

[jira] [Commented] (SPARK-11219) Make Parameter Description Format Consistent in PySpark.MLlib

2016-01-08 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090292#comment-15090292 ] Bryan Cutler commented on SPARK-11219: -- That's my fault [~josephkb], I was instructing to go up to

[jira] [Created] (SPARK-12720) SQL generation support for cube, rollup, and grouping set

2016-01-08 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12720: -- Summary: SQL generation support for cube, rollup, and grouping set Key: SPARK-12720 URL: https://issues.apache.org/jira/browse/SPARK-12720 Project: Spark Issue

[jira] [Created] (SPARK-12721) SQL generation support for script transformation

2016-01-08 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12721: -- Summary: SQL generation support for script transformation Key: SPARK-12721 URL: https://issues.apache.org/jira/browse/SPARK-12721 Project: Spark Issue Type:

[jira] [Updated] (SPARK-12717) pyspark broadcast fails when using multiple threads

2016-01-08 Thread Edward Walker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Walker updated SPARK-12717: -- Description: The following multi-threaded program that uses broadcast variables consistently

[jira] [Commented] (SPARK-11012) Canonicalize view definitions

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090110#comment-15090110 ] Cheng Lian commented on SPARK-11012: Done. > Canonicalize view definitions >

[jira] [Updated] (SPARK-11012) Canonicalize view definitions

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-11012: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > Canonicalize view definitions >

[jira] [Created] (SPARK-12728) Integrate SQL generation feature with native view

2016-01-08 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12728: -- Summary: Integrate SQL generation feature with native view Key: SPARK-12728 URL: https://issues.apache.org/jira/browse/SPARK-12728 Project: Spark Issue Type:

[jira] [Commented] (SPARK-12655) GraphX does not unpersist RDDs

2016-01-08 Thread Jason C Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090165#comment-15090165 ] Jason C Lee commented on SPARK-12655: - The VertexRDD and EdgeRDD you see are created during the

[jira] [Updated] (SPARK-12718) SQL generation support for window functions

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12718: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > SQL generation support for window functions

[jira] [Updated] (SPARK-12720) SQL generation support for cube, rollup, and grouping set

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12720: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > SQL generation support for cube, rollup, and

[jira] [Updated] (SPARK-12719) SQL generation support for generators (including UDTF)

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12719: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > SQL generation support for generators

[jira] [Updated] (SPARK-11944) Python API for mllib.clustering.BisectingKMeans

2016-01-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11944: -- Assignee: holdenk Target Version/s: 2.0.0 > Python API for

[jira] [Updated] (SPARK-11826) Subtract BlockMatrix

2016-01-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11826: -- Target Version/s: (was: 2.0.0) > Subtract BlockMatrix > > >

[jira] [Commented] (SPARK-11214) Join with Unicode-String results wrong empty

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090222#comment-15090222 ] Davies Liu commented on SPARK-11214: [~xDSticker] Could you try this in master or 1.6? I couldn't

[jira] [Commented] (SPARK-12705) Sorting column can't be resolved if it's not in projection

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089994#comment-15089994 ] Davies Liu commented on SPARK-12705: [~smilegator]I had updated JIRA to have a reproducable test

[jira] [Commented] (SPARK-11012) Canonicalize view definitions

2016-01-08 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090033#comment-15090033 ] Yin Huai commented on SPARK-11012: -- [~lian cheng] Let's create jiras for all sub-tasks. > Canonicalize

[jira] [Updated] (SPARK-12593) Convert resolved logical plans back to SQL query strings

2016-01-08 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12593: - Issue Type: Sub-task (was: New Feature) Parent: SPARK-11012 > Convert resolved logical plans

  1   2   3   >