[jira] [Commented] (SPARK-9383) Merge script should reset back to previous ref instead of detached commit

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15092761#comment-15092761 ] Apache Spark commented on SPARK-9383: - User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-12685) word2vec trainWordsCount gets overflow

2016-01-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15092855#comment-15092855 ] Joseph K. Bradley commented on SPARK-12685: --- It looks easy to backport. I targeted it for 1.4+

[jira] [Updated] (SPARK-12685) word2vec trainWordsCount gets overflow

2016-01-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12685: -- Shepherd: Joseph K. Bradley Target Version/s: 1.4.2, 1.5.3, 1.6.1, 2.0.0 >

[jira] [Assigned] (SPARK-12655) GraphX does not unpersist RDDs

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12655: Assignee: Apache Spark > GraphX does not unpersist RDDs > --

[jira] [Commented] (SPARK-12655) GraphX does not unpersist RDDs

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15092986#comment-15092986 ] Apache Spark commented on SPARK-12655: -- User 'jasoncl' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12655) GraphX does not unpersist RDDs

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12655: Assignee: (was: Apache Spark) > GraphX does not unpersist RDDs >

[jira] [Closed] (SPARK-12743) spark.executor.memory is ignored by spark-submit in Standalone Cluster mode

2016-01-11 Thread Alan Braithwaite (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite closed SPARK-12743. Resolution: Cannot Reproduce I can't reproduce it either this morning. Gotta love

[jira] [Assigned] (SPARK-12685) word2vec trainWordsCount gets overflow

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12685: Assignee: Apache Spark (was: yuhao yang) > word2vec trainWordsCount gets overflow >

[jira] [Reopened] (SPARK-12685) word2vec trainWordsCount gets overflow

2016-01-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reopened SPARK-12685: --- Reopening so I don't forget backports > word2vec trainWordsCount gets overflow >

[jira] [Assigned] (SPARK-12685) word2vec trainWordsCount gets overflow

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12685: Assignee: yuhao yang (was: Apache Spark) > word2vec trainWordsCount gets overflow >

[jira] [Created] (SPARK-12761) Clean up duplicated code in scala 2.11 repl.Main

2016-01-11 Thread Jakob Odersky (JIRA)
Jakob Odersky created SPARK-12761: - Summary: Clean up duplicated code in scala 2.11 repl.Main Key: SPARK-12761 URL: https://issues.apache.org/jira/browse/SPARK-12761 Project: Spark Issue

[jira] [Assigned] (SPARK-12761) Clean up duplicated code in scala 2.11 repl.Main

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12761: Assignee: (was: Apache Spark) > Clean up duplicated code in scala 2.11 repl.Main >

[jira] [Commented] (SPARK-12761) Clean up duplicated code in scala 2.11 repl.Main

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15092963#comment-15092963 ] Apache Spark commented on SPARK-12761: -- User 'jodersky' has created a pull request for this issue:

[jira] [Updated] (SPARK-12732) Fix LinearRegression.train for the case when label is constant and fitIntercept=false

2016-01-11 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-12732: Assignee: Imran Younus > Fix LinearRegression.train for the case when label is constant and >

[jira] [Commented] (SPARK-12761) Clean up duplicated code in scala 2.11 repl.Main

2016-01-11 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15092964#comment-15092964 ] Jakob Odersky commented on SPARK-12761: --- @vanzin, I think this is your area of expertise > Clean

[jira] [Assigned] (SPARK-12761) Clean up duplicated code in scala 2.11 repl.Main

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12761: Assignee: Apache Spark > Clean up duplicated code in scala 2.11 repl.Main >

[jira] [Commented] (SPARK-9656) Add missing methods to linalg.distributed

2016-01-11 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15093018#comment-15093018 ] Mike Dusenberry commented on SPARK-9656: [~josephkb] Now that SPARK-11497 has been merged, this is

[jira] [Closed] (SPARK-12745) Limit is not supported inside Set Operation

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-12745. --- Resolution: Later > Limit is not supported inside Set Operation >

[jira] [Assigned] (SPARK-9383) Merge script should reset back to previous ref instead of detached commit

2016-01-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-9383: - Assignee: Josh Rosen > Merge script should reset back to previous ref instead of detached commit

[jira] [Assigned] (SPARK-12724) SQL generation support for persisted data source relations

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12724: Assignee: Apache Spark > SQL generation support for persisted data source relations >

[jira] [Resolved] (SPARK-12576) Enable expression parsing (used in DataFrames)

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12576. - Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.0.0 > Enable

[jira] [Commented] (SPARK-12724) SQL generation support for persisted data source relations

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15092971#comment-15092971 ] Apache Spark commented on SPARK-12724: -- User 'liancheng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12724) SQL generation support for persisted data source relations

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12724: Assignee: (was: Apache Spark) > SQL generation support for persisted data source

[jira] [Resolved] (SPARK-12758) Add note to Spark SQL Migration section about SPARK-11724

2016-01-11 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12758. -- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved

[jira] [Created] (SPARK-12759) Spark should fail fast if --executor-memory is too small for spark to start

2016-01-11 Thread Imran Rashid (JIRA)
Imran Rashid created SPARK-12759: Summary: Spark should fail fast if --executor-memory is too small for spark to start Key: SPARK-12759 URL: https://issues.apache.org/jira/browse/SPARK-12759 Project:

[jira] [Resolved] (SPARK-12603) PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

2016-01-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12603. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10552

[jira] [Comment Edited] (SPARK-12685) word2vec trainWordsCount gets overflow

2016-01-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15092855#comment-15092855 ] Joseph K. Bradley edited comment on SPARK-12685 at 1/11/16 10:50 PM: -

[jira] [Created] (SPARK-12760) inaccurate description for difference between local vs cluster mode

2016-01-11 Thread Mortada Mehyar (JIRA)
Mortada Mehyar created SPARK-12760: -- Summary: inaccurate description for difference between local vs cluster mode Key: SPARK-12760 URL: https://issues.apache.org/jira/browse/SPARK-12760 Project:

[jira] [Resolved] (SPARK-10809) Single-document topicDistributions method for LocalLDAModel

2016-01-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-10809. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9484

[jira] [Resolved] (SPARK-12685) word2vec trainWordsCount gets overflow

2016-01-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12685. --- Resolution: Fixed Fix Version/s: 2.0.0 > word2vec trainWordsCount gets

[jira] [Updated] (SPARK-12577) better support of parentheses in partition by and order by clause of window function's over clause

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12577: Assignee: Liang-Chi Hsieh > better support of parentheses in partition by and order by clause of

[jira] [Commented] (SPARK-9844) File appender race condition during SparkWorker shutdown

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15093055#comment-15093055 ] Apache Spark commented on SPARK-9844: - User 'BryanCutler' has created a pull request for this issue:

[jira] [Assigned] (SPARK-9844) File appender race condition during SparkWorker shutdown

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9844: --- Assignee: (was: Apache Spark) > File appender race condition during SparkWorker shutdown

[jira] [Assigned] (SPARK-9844) File appender race condition during SparkWorker shutdown

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9844: --- Assignee: Apache Spark > File appender race condition during SparkWorker shutdown >

[jira] [Comment Edited] (SPARK-7250) computeInverse for RowMatrix

2016-01-11 Thread Stephanie Rivera (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14521510#comment-14521510 ] Stephanie Rivera edited comment on SPARK-7250 at 1/11/16 10:14 PM: --- OK.

[jira] [Issue Comment Deleted] (SPARK-3369) Java mapPartitions Iterator->Iterable is inconsistent with Scala's Iterator->Iterator

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3369: - Comment: was deleted (was: Attaching only a patch for now, not a PR, to demonstrate the extent of the

[jira] [Resolved] (SPARK-5883) Add compression scheme in VertexAttributeBlock for shipping vertices to edge partitions

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5883. -- Resolution: Won't Fix > Add compression scheme in VertexAttributeBlock for shipping vertices to edge >

[jira] [Resolved] (SPARK-5876) generalize the type of categoricalFeaturesInfo to PartialFunction[Int, Int]

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5876. -- Resolution: Won't Fix > generalize the type of categoricalFeaturesInfo to PartialFunction[Int, Int] >

[jira] [Updated] (SPARK-12734) Fix Netty exclusions and use Maven Enforcer to prevent bug from being reintroduced

2016-01-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12734: --- Fix Version/s: 1.6.1 > Fix Netty exclusions and use Maven Enforcer to prevent bug from being >

[jira] [Created] (SPARK-12750) Java class method don't work properly

2016-01-11 Thread Gramce (JIRA)
Gramce created SPARK-12750: -- Summary: Java class method don't work properly Key: SPARK-12750 URL: https://issues.apache.org/jira/browse/SPARK-12750 Project: Spark Issue Type: Question

[jira] [Updated] (SPARK-12749) Spark SQL JSON schema infernce should allow floating-point numbers as BigDecimal

2016-01-11 Thread Brandon Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Bradley updated SPARK-12749: Summary: Spark SQL JSON schema infernce should allow floating-point numbers as BigDecimal

[jira] [Commented] (SPARK-12642) improve the hash expression to be decoupled from unsafe row

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091659#comment-15091659 ] Apache Spark commented on SPARK-12642: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Updated] (SPARK-3369) Java mapPartitions Iterator->Iterable is inconsistent with Scala's Iterator->Iterator

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3369: - Attachment: (was: FlatMapIterator.patch) > Java mapPartitions Iterator->Iterable is inconsistent with

[jira] [Resolved] (SPARK-6425) Add parallel Q-learning algorithm to MLLib

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6425. -- Resolution: Won't Fix > Add parallel Q-learning algorithm to MLLib >

[jira] [Resolved] (SPARK-3878) Benchmarks and common tests for mllib algorithm

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3878. -- Resolution: Won't Fix > Benchmarks and common tests for mllib algorithm >

[jira] [Resolved] (SPARK-975) Spark Replay Debugger

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-975. - Resolution: Won't Fix > Spark Replay Debugger > - > > Key: SPARK-975 >

[jira] [Resolved] (SPARK-6616) IsStopped set to true in before stop() is complete.

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6616. -- Resolution: Not A Problem I think this was obsoleted by subsequent changes that made this more

[jira] [Resolved] (SPARK-12260) Graceful Shutdown with In-Memory State

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12260. --- Resolution: Won't Fix > Graceful Shutdown with In-Memory State >

[jira] [Resolved] (SPARK-12269) Update aws-java-sdk version

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12269. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10256

[jira] [Commented] (SPARK-9825) Spark overwrites remote cluster "final" properties with local config

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091687#comment-15091687 ] Sean Owen commented on SPARK-9825: -- I don't believe Spark modifies any of these settings. Is that even

[jira] [Commented] (SPARK-9825) Spark overwrites remote cluster "final" properties with local config

2016-01-11 Thread Rok Roskar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091718#comment-15091718 ] Rok Roskar commented on SPARK-9825: --- I'm not sure who has the responsibility to honor the "final"

[jira] [Updated] (SPARK-12734) Fix Netty exclusions and use Maven Enforcer to prevent bug from being reintroduced

2016-01-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12734: --- Fix Version/s: 1.5.3 > Fix Netty exclusions and use Maven Enforcer to prevent bug from being >

[jira] [Created] (SPARK-12749) Spark SQL JSON schema infernce should allow parsing numbers as BigDecimal

2016-01-11 Thread Brandon Bradley (JIRA)
Brandon Bradley created SPARK-12749: --- Summary: Spark SQL JSON schema infernce should allow parsing numbers as BigDecimal Key: SPARK-12749 URL: https://issues.apache.org/jira/browse/SPARK-12749

[jira] [Updated] (SPARK-12749) Spark SQL JSON schema infernce should allow floating-point numbers as BigDecimal

2016-01-11 Thread Brandon Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Bradley updated SPARK-12749: Description: Hello, Spark SQL JSON parsing has no options for producing BigDecimal from

[jira] [Resolved] (SPARK-12750) Java class method don't work properly

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12750. --- Resolution: Not A Problem The problem is as it says. You've written Java code such that your

[jira] [Resolved] (SPARK-6589) SQLUserDefinedType failed in spark-shell

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6589. -- Resolution: Not A Problem I think this is, effectively, "not a problem" in the sense that this is just

[jira] [Resolved] (SPARK-6401) Unable to load a old API input format in Spark streaming

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6401. -- Resolution: Won't Fix Although the old APIs still exist in new Hadoop, given we're moving away from

[jira] [Resolved] (SPARK-6282) Strange Python import error when using random() in a lambda function

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6282. -- Resolution: Not A Problem Seems like some issue with Python libraries > Strange Python import error

[jira] [Updated] (SPARK-12751) Traits generated by SharedParamsCodeGen should not be private

2016-01-11 Thread Wojciech Jurczyk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wojciech Jurczyk updated SPARK-12751: - Description: Many Estimators and Transformers mix in traits generated by

[jira] [Assigned] (SPARK-12642) improve the hash expression to be decoupled from unsafe row

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12642: Assignee: Apache Spark > improve the hash expression to be decoupled from unsafe row >

[jira] [Assigned] (SPARK-12642) improve the hash expression to be decoupled from unsafe row

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12642: Assignee: (was: Apache Spark) > improve the hash expression to be decoupled from

[jira] [Commented] (SPARK-7615) MLLIB Word2Vec wordVectors divided by Euclidean Norm equals to zero

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091762#comment-15091762 ] Apache Spark commented on SPARK-7615: - User 'srowen' has created a pull request for this issue:

[jira] [Updated] (SPARK-12734) Fix Netty exclusions and use Maven Enforcer to prevent bug from being reintroduced

2016-01-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12734: --- Description: Netty classes are published under artifacts with different names, so our build needs

[jira] [Resolved] (SPARK-4970) Do not read spark.executor.memory from spark-defaults.conf in SparkSubmitSuite

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4970. -- Resolution: Not A Problem > Do not read spark.executor.memory from spark-defaults.conf in

[jira] [Commented] (SPARK-12743) spark.executor.memory is ignored by spark-submit in Standalone Cluster mode

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091702#comment-15091702 ] Sean Owen commented on SPARK-12743: --- I can't reproduce this; I started a simple master/executor on my

[jira] [Created] (SPARK-12751) Traits generated by SharedParamsCodeGen should not be private

2016-01-11 Thread Wojciech Jurczyk (JIRA)
Wojciech Jurczyk created SPARK-12751: Summary: Traits generated by SharedParamsCodeGen should not be private Key: SPARK-12751 URL: https://issues.apache.org/jira/browse/SPARK-12751 Project: Spark

[jira] [Updated] (SPARK-12751) Traits generated by SharedParamsCodeGen should not be private

2016-01-11 Thread Wojciech Jurczyk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wojciech Jurczyk updated SPARK-12751: - Priority: Minor (was: Major) > Traits generated by SharedParamsCodeGen should not be

[jira] [Assigned] (SPARK-12545) Support exists condition

2016-01-11 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12545: -- Assignee: Davies Liu > Support exists condition > > >

[jira] [Updated] (SPARK-12746) ArrayType(_, true) should also accept ArrayType(_, false)

2016-01-11 Thread Earthson Lu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Earthson Lu updated SPARK-12746: Description: I see CountVectorizer has schema check for ArrayType which has ArrayType(StringType,

[jira] [Resolved] (SPARK-6068) KMeans Parallel test may fail

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6068. -- Resolution: Won't Fix > KMeans Parallel test may fail > - > >

[jira] [Updated] (SPARK-12734) Fix Netty exclusions and use Maven Enforcer to prevent bug from being reintroduced

2016-01-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12734: --- Description: Netty classes are published under artifacts with different names, so our build needs

[jira] [Commented] (SPARK-12747) Postgres JDBC ArrayType(DoubleType) 'Unable to find server array type'

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091722#comment-15091722 ] Apache Spark commented on SPARK-12747: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12747) Postgres JDBC ArrayType(DoubleType) 'Unable to find server array type'

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12747: Assignee: Apache Spark > Postgres JDBC ArrayType(DoubleType) 'Unable to find server array

[jira] [Assigned] (SPARK-12747) Postgres JDBC ArrayType(DoubleType) 'Unable to find server array type'

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12747: Assignee: (was: Apache Spark) > Postgres JDBC ArrayType(DoubleType) 'Unable to find

[jira] [Resolved] (SPARK-12529) Spark streaming: java.lang.NoSuchFieldException: SHUTDOWN_HOOK_PRIORITY

2016-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12529. --- Resolution: Cannot Reproduce > Spark streaming: java.lang.NoSuchFieldException:

[jira] [Updated] (SPARK-12664) Expose raw prediction scores in MultilayerPerceptronClassificationModel

2016-01-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12664: Priority: Major (was: Minor) > Expose raw prediction scores in

[jira] [Updated] (SPARK-12385) Push projection into Join

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12385: Component/s: Optimizer > Push projection into Join > - > >

[jira] [Assigned] (SPARK-12746) ArrayType(_, true) should also accept ArrayType(_, false)

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12746: Assignee: Apache Spark > ArrayType(_, true) should also accept ArrayType(_, false) >

[jira] [Commented] (SPARK-12746) ArrayType(_, true) should also accept ArrayType(_, false)

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15093155#comment-15093155 ] Apache Spark commented on SPARK-12746: -- User 'Earthson' has created a pull request for this issue:

[jira] [Commented] (SPARK-12602) Join Reordering: Pushing Inner Join Through Outer Join

2016-01-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15093158#comment-15093158 ] Xiao Li commented on SPARK-12602: - Sure, Thanks! > Join Reordering: Pushing Inner Join Through Outer

[jira] [Assigned] (SPARK-12746) ArrayType(_, true) should also accept ArrayType(_, false)

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12746: Assignee: (was: Apache Spark) > ArrayType(_, true) should also accept ArrayType(_,

[jira] [Updated] (SPARK-12746) ArrayType(_, true) should also accept ArrayType(_, false)

2016-01-11 Thread Earthson Lu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Earthson Lu updated SPARK-12746: Shepherd: Joseph K. Bradley (was: Xiangrui Meng) > ArrayType(_, true) should also accept

[jira] [Reopened] (SPARK-11823) HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

2016-01-11 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reopened SPARK-11823: -- Assignee: (was: Josh Rosen) > HiveThriftBinaryServerSuite tests timing out, leaves hanging

[jira] [Assigned] (SPARK-11823) HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11823: Assignee: Apache Spark > HiveThriftBinaryServerSuite tests timing out, leaves hanging

[jira] [Assigned] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10620: Assignee: Apache Spark > Look into whether accumulator mechanism can replace TaskMetrics

[jira] [Assigned] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10620: Assignee: (was: Apache Spark) > Look into whether accumulator mechanism can replace

[jira] [Commented] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15093209#comment-15093209 ] Apache Spark commented on SPARK-10620: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Created] (SPARK-12765) CountVectorizerModel.transform lost the transformSchema

2016-01-11 Thread sloth (JIRA)
sloth created SPARK-12765: - Summary: CountVectorizerModel.transform lost the transformSchema Key: SPARK-12765 URL: https://issues.apache.org/jira/browse/SPARK-12765 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-12769) Remove If expression

2016-01-11 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12769: --- Summary: Remove If expression Key: SPARK-12769 URL: https://issues.apache.org/jira/browse/SPARK-12769 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-12717) pyspark broadcast fails when using multiple threads

2016-01-11 Thread Edward Walker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Walker updated SPARK-12717: -- Description: The following multi-threaded program that uses broadcast variables consistently

[jira] [Created] (SPARK-12770) Implement rules for removing unnecessary branches for CaseWhen in SimplifyConditionals

2016-01-11 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12770: --- Summary: Implement rules for removing unnecessary branches for CaseWhen in SimplifyConditionals Key: SPARK-12770 URL: https://issues.apache.org/jira/browse/SPARK-12770

[jira] [Updated] (SPARK-12765) CountVectorizerModel.transform lost the transformSchema

2016-01-11 Thread sloth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sloth updated SPARK-12765: -- Remaining Estimate: (was: 1m) Original Estimate: (was: 1m) > CountVectorizerModel.transform lost

[jira] [Updated] (SPARK-12717) pyspark broadcast fails when using multiple threads

2016-01-11 Thread Edward Walker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Walker updated SPARK-12717: -- Priority: Critical (was: Major) > pyspark broadcast fails when using multiple threads >

[jira] [Created] (SPARK-12768) Remove CaseKeyWhen

2016-01-11 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12768: --- Summary: Remove CaseKeyWhen Key: SPARK-12768 URL: https://issues.apache.org/jira/browse/SPARK-12768 Project: Spark Issue Type: Sub-task Components:

[jira] [Created] (SPARK-12767) Improve conditional expressions

2016-01-11 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12767: --- Summary: Improve conditional expressions Key: SPARK-12767 URL: https://issues.apache.org/jira/browse/SPARK-12767 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-12066) spark sql throw java.lang.ArrayIndexOutOfBoundsException when use table.* with join

2016-01-11 Thread Kaiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15093144#comment-15093144 ] Kaiyuan Yang commented on SPARK-12066: -- Ricky Yang, if you still think this is a bug, please provide

[jira] [Updated] (SPARK-12532) Join-key Pushdown via Predicate Transitivity

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12532: Component/s: Optimizer > Join-key Pushdown via Predicate Transitivity >

[jira] [Commented] (SPARK-12685) word2vec trainWordsCount gets overflow

2016-01-11 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15093188#comment-15093188 ] yuhao yang commented on SPARK-12685: Hi [~josephkb] I suppose it will require 3 different PRs, right?

[jira] [Commented] (SPARK-12430) Temporary folders do not get deleted after Task completes causing problems with disk space.

2016-01-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-12430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15093415#comment-15093415 ] Jean-Baptiste Onofré commented on SPARK-12430: -- Just to be sure: you don't use

[jira] [Closed] (SPARK-12532) Join-key Pushdown via Predicate Transitivity

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-12532. --- Resolution: Later Assignee: (was: Xiao Li) Target Version/s: (was: 2.0.0)

  1   2   3   >