[jira] [Created] (SPARK-12226) Docs for Mesos don't mention shaded protobuf version

2015-12-08 Thread Charles Allen (JIRA)
Charles Allen created SPARK-12226: - Summary: Docs for Mesos don't mention shaded protobuf version Key: SPARK-12226 URL: https://issues.apache.org/jira/browse/SPARK-12226 Project: Spark Issue

[jira] [Updated] (SPARK-12226) Docs for Mesos don't mention shaded protobuf version

2015-12-08 Thread Charles Allen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Allen updated SPARK-12226: -- Priority: Minor (was: Major) > Docs for Mesos don't mention shaded protobuf version >

[jira] [Closed] (SPARK-12118) SparkR: Documentation change for isNaN

2015-12-08 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang closed SPARK-12118. --- Resolution: Duplicate > SparkR: Documentation change for isNaN >

[jira] [Commented] (SPARK-12227) Support drop multiple columns specified by Column class in DataFrame API

2015-12-08 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047942#comment-15047942 ] Sun Rui commented on SPARK-12227: - cc [~te...@apache.org] > Support drop multiple columns specified by

[jira] [Commented] (SPARK-12118) SparkR: Documentation change for isNaN

2015-12-08 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047940#comment-15047940 ] Yanbo Liang commented on SPARK-12118: - Yes, this is similar with SPARK-12071, I will close this one

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-08 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047965#comment-15047965 ] Tao Li commented on SPARK-12179: The row_number implementation is as follows: package UDF; import

[jira] [Created] (SPARK-12229) How to Perform spark submit of application written in scala from Node js

2015-12-08 Thread himanshu singhal (JIRA)
himanshu singhal created SPARK-12229: Summary: How to Perform spark submit of application written in scala from Node js Key: SPARK-12229 URL: https://issues.apache.org/jira/browse/SPARK-12229

[jira] [Commented] (SPARK-10509) Excessive param boiler plate code

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048013#comment-15048013 ] Apache Spark commented on SPARK-10509: -- User 'holdenk' has created a pull request for this issue:

[jira] [Created] (SPARK-12232) Consider exporting in R read.table

2015-12-08 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12232: Summary: Consider exporting in R read.table Key: SPARK-12232 URL: https://issues.apache.org/jira/browse/SPARK-12232 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12233) Cannot specify a data frame column during join

2015-12-08 Thread Fengdong Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengdong Yu updated SPARK-12233: Description: Background: two tables: tableA(id string, name string, gender string) tableB(id

[jira] [Commented] (SPARK-11551) Replace example code in ml-features.md using include_example

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048161#comment-15048161 ] Apache Spark commented on SPARK-11551: -- User 'yinxusen' has created a pull request for this issue:

[jira] [Created] (SPARK-12235) Enhance mutate() to support replace existing columns

2015-12-08 Thread Sun Rui (JIRA)
Sun Rui created SPARK-12235: --- Summary: Enhance mutate() to support replace existing columns Key: SPARK-12235 URL: https://issues.apache.org/jira/browse/SPARK-12235 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-12222) deserialize RoaringBitmap using Kryo serializer throw Buffer underflow exception

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1: Assignee: Apache Spark > deserialize RoaringBitmap using Kryo serializer throw Buffer

[jira] [Assigned] (SPARK-12222) deserialize RoaringBitmap using Kryo serializer throw Buffer underflow exception

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1: Assignee: (was: Apache Spark) > deserialize RoaringBitmap using Kryo serializer throw

[jira] [Commented] (SPARK-12222) deserialize RoaringBitmap using Kryo serializer throw Buffer underflow exception

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047917#comment-15047917 ] Apache Spark commented on SPARK-1: -- User 'scwf' has created a pull request for this issue:

[jira] [Commented] (SPARK-12233) Cannot specify a data frame column during join

2015-12-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048096#comment-15048096 ] Xiao Li commented on SPARK-12233: - This is another self join issue. I will try to see if it is a

[jira] [Commented] (SPARK-12227) Support drop multiple columns specified by Column class in DataFrame API

2015-12-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048116#comment-15048116 ] Hyukjin Kwon commented on SPARK-12227: -- Could I quickly do this if it is not a big deal? I was

[jira] [Commented] (SPARK-12233) Cannot specify a data frame column during join

2015-12-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048186#comment-15048186 ] Xiao Li commented on SPARK-12233: - {code} val df1 = Seq(1, 2, 3).map(i => (i, i.toString,

[jira] [Commented] (SPARK-12235) Enhance mutate() to support replace existing columns

2015-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048204#comment-15048204 ] Felix Cheung commented on SPARK-12235: -- Is this related to

[jira] [Commented] (SPARK-12188) [SQL] Code refactoring and comment correction in Dataset APIs

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047951#comment-15047951 ] Apache Spark commented on SPARK-12188: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Created] (SPARK-12230) WeightedLeastSquares.fit() should handle division by zero properly if standard deviation of target variable is zero.

2015-12-08 Thread Imran Younus (JIRA)
Imran Younus created SPARK-12230: Summary: WeightedLeastSquares.fit() should handle division by zero properly if standard deviation of target variable is zero. Key: SPARK-12230 URL:

[jira] [Created] (SPARK-12231) Failed to generate predicate Error when using dropna

2015-12-08 Thread yahsuan, chang (JIRA)
yahsuan, chang created SPARK-12231: -- Summary: Failed to generate predicate Error when using dropna Key: SPARK-12231 URL: https://issues.apache.org/jira/browse/SPARK-12231 Project: Spark

[jira] [Commented] (SPARK-12233) Cannot specify a data frame column during join

2015-12-08 Thread Fengdong Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048091#comment-15048091 ] Fengdong Yu commented on SPARK-12233: - Updated. [~smilegator] [~holdenk] > Cannot specify a data

[jira] [Resolved] (SPARK-11676) Parquet filter tests all pass if filters are not really pushed down

2015-12-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-11676. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9659

[jira] [Assigned] (SPARK-12235) Enhance mutate() to support replace existing columns

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12235: Assignee: Apache Spark > Enhance mutate() to support replace existing columns >

[jira] [Assigned] (SPARK-12235) Enhance mutate() to support replace existing columns

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12235: Assignee: (was: Apache Spark) > Enhance mutate() to support replace existing columns

[jira] [Commented] (SPARK-12235) Enhance mutate() to support replace existing columns

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048190#comment-15048190 ] Apache Spark commented on SPARK-12235: -- User 'sun-rui' has created a pull request for this issue:

[jira] [Commented] (SPARK-12232) Consider exporting read.table in R

2015-12-08 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048189#comment-15048189 ] Yanbo Liang commented on SPARK-12232: - I vote for do not expose read.table because it has different

[jira] [Created] (SPARK-12218) Boolean logic in sql does not work "not (A and B)" is not the same as "(not A) or (not B)"

2015-12-08 Thread Irakli Machabeli (JIRA)
Irakli Machabeli created SPARK-12218: Summary: Boolean logic in sql does not work "not (A and B)" is not the same as "(not A) or (not B)" Key: SPARK-12218 URL:

[jira] [Created] (SPARK-12219) Spark 1.5.2 code does not build on Scala 2.11.7 with SBT assembly

2015-12-08 Thread Rodrigo Boavida (JIRA)
Rodrigo Boavida created SPARK-12219: --- Summary: Spark 1.5.2 code does not build on Scala 2.11.7 with SBT assembly Key: SPARK-12219 URL: https://issues.apache.org/jira/browse/SPARK-12219 Project:

[jira] [Updated] (SPARK-12214) Spark to provide an API to save user-defined metadata as part of Sequence File header

2015-12-08 Thread Naveen Pishe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naveen Pishe updated SPARK-12214: - Issue Type: Improvement (was: New Feature) > Spark to provide an API to save user-defined

[jira] [Created] (SPARK-12215) User guide section for KMeans in spark.ml

2015-12-08 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-12215: - Summary: User guide section for KMeans in spark.ml Key: SPARK-12215 URL: https://issues.apache.org/jira/browse/SPARK-12215 Project: Spark Issue

[jira] [Updated] (SPARK-12214) Spark to provide an API to save user-defined metadata as part of Sequence File header

2015-12-08 Thread Naveen Pishe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naveen Pishe updated SPARK-12214: - Affects Version/s: 1.4.0 1.5.0 > Spark to provide an API to save

[jira] [Updated] (SPARK-12214) Spark to provide an API to save user-defined metadata as part of Sequence File header

2015-12-08 Thread Naveen Pishe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naveen Pishe updated SPARK-12214: - Description: There is requirement to save "user-defined" Metadata as part of Sequence File

[jira] [Created] (SPARK-12216) Spark failed to delete temp directory

2015-12-08 Thread stefan (JIRA)
stefan created SPARK-12216: -- Summary: Spark failed to delete temp directory Key: SPARK-12216 URL: https://issues.apache.org/jira/browse/SPARK-12216 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-6523) Error when get attribute of StandardScalerModel, When use python api

2015-12-08 Thread Igor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047543#comment-15047543 ] Igor edited comment on SPARK-6523 at 12/8/15 9:58 PM: -- SPARK-6643 did not address the

[jira] [Created] (SPARK-12217) Document invalid handling for StringIndexer

2015-12-08 Thread Benjamin Fradet (JIRA)
Benjamin Fradet created SPARK-12217: --- Summary: Document invalid handling for StringIndexer Key: SPARK-12217 URL: https://issues.apache.org/jira/browse/SPARK-12217 Project: Spark Issue

[jira] [Comment Edited] (SPARK-6523) Error when get attribute of StandardScalerModel, When use python api

2015-12-08 Thread Igor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047543#comment-15047543 ] Igor edited comment on SPARK-6523 at 12/8/15 9:59 PM: -- [~josephkb] SPARK-6643 did not

[jira] [Comment Edited] (SPARK-6523) Error when get attribute of StandardScalerModel, When use python api

2015-12-08 Thread Igor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047543#comment-15047543 ] Igor edited comment on SPARK-6523 at 12/8/15 9:59 PM: -- [~josephkb] SPARK-6643 did not

[jira] [Commented] (SPARK-11965) Update user guide for RFormula feature interactions

2015-12-08 Thread Eric Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047525#comment-15047525 ] Eric Liang commented on SPARK-11965: Will do On Tue, Dec 8, 2015, 1:11 PM Joseph K. Bradley (JIRA)

[jira] [Issue Comment Deleted] (SPARK-11965) Update user guide for RFormula feature interactions

2015-12-08 Thread Eric Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Liang updated SPARK-11965: --- Comment: was deleted (was: Will do On Tue, Dec 8, 2015, 1:11 PM Joseph K. Bradley (JIRA)

[jira] [Commented] (SPARK-6523) Error when get attribute of StandardScalerModel, When use python api

2015-12-08 Thread Igor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047543#comment-15047543 ] Igor commented on SPARK-6523: - SPARK-6643 did not address the issue. There is still no way to means or

[jira] [Commented] (SPARK-12217) Document invalid handling for StringIndexer

2015-12-08 Thread Benjamin Fradet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047545#comment-15047545 ] Benjamin Fradet commented on SPARK-12217: - I've started working on this. > Document invalid

<    1   2   3