[jira] [Closed] (SPARK-12040) Add toJson/fromJson to Vector/Vectors for PySpark

2015-12-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-12040. - Resolution: Not A Problem > Add toJson/fromJson to Vector/Vectors for PySpark >

[jira] [Resolved] (SPARK-11605) ML 1.6 QA: API: Java compatibility, docs

2015-12-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-11605. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Commented] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2015-12-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047229#comment-15047229 ] Xin Ren commented on SPARK-12071: - Hi, I'd like to take up this ticket if no one is working on it. By

[jira] [Commented] (SPARK-8517) Improve the organization and style of MLlib's user guide

2015-12-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047270#comment-15047270 ] Joseph K. Bradley commented on SPARK-8517: -- +1 on copying content > Improve the organization and

[jira] [Created] (SPARK-12211) Incorrect version number in graphx doc for migration from 1.1

2015-12-08 Thread Andrew Ray (JIRA)
Andrew Ray created SPARK-12211: -- Summary: Incorrect version number in graphx doc for migration from 1.1 Key: SPARK-12211 URL: https://issues.apache.org/jira/browse/SPARK-12211 Project: Spark

[jira] [Resolved] (SPARK-12159) Add user guide section for IndexToString transformer

2015-12-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12159. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Updated] (SPARK-11602) ML 1.6 QA: API: New Scala APIs, docs

2015-12-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11602: -- Shepherd: Joseph K. Bradley > ML 1.6 QA: API: New Scala APIs, docs >

[jira] [Resolved] (SPARK-9670) Examples: Check for new APIs requiring example code

2015-12-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9670. -- Resolution: Fixed Fix Version/s: 1.6.0 I'm going to mark this as resolved since

[jira] [Commented] (SPARK-8855) Python API for Association Rules

2015-12-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047432#comment-15047432 ] Joseph K. Bradley commented on SPARK-8855: -- {quote} 1) Create the class "Association Rules"

[jira] [Updated] (SPARK-11965) Update user guide for RFormula feature interactions

2015-12-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11965: -- Description: Update the user guide for RFormula to cover feature interactions (was:

[jira] [Updated] (SPARK-11965) Update user guide for RFormula feature interactions

2015-12-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11965: -- Assignee: (was: Eric Liang) > Update user guide for RFormula feature interactions

[jira] [Created] (SPARK-12213) Query with only one distinct should not having on expand

2015-12-08 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12213: -- Summary: Query with only one distinct should not having on expand Key: SPARK-12213 URL: https://issues.apache.org/jira/browse/SPARK-12213 Project: Spark Issue

[jira] [Updated] (SPARK-12159) Add user guide section for IndexToString transformer

2015-12-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12159: -- Target Version/s: 1.6.0 > Add user guide section for IndexToString transformer >

[jira] [Commented] (SPARK-11965) Update user guide for RFormula feature interactions

2015-12-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047475#comment-15047475 ] Joseph K. Bradley commented on SPARK-11965: --- [~yanboliang] Would you be able to take this JIRA?

[jira] [Created] (SPARK-12214) Spark to provide an API to save user-defined metadata as part of Sequence File header

2015-12-08 Thread Naveen Pishe (JIRA)
Naveen Pishe created SPARK-12214: Summary: Spark to provide an API to save user-defined metadata as part of Sequence File header Key: SPARK-12214 URL: https://issues.apache.org/jira/browse/SPARK-12214

[jira] [Updated] (SPARK-12236) JDBC filter tests all pass if filters are not really pushed down

2015-12-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-12236: - Description: It is similar with https://issues.apache.org/jira/browse/SPARK-11676 and

[jira] [Commented] (SPARK-12233) Cannot specify a data frame column during join

2015-12-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048232#comment-15048232 ] Xiao Li commented on SPARK-12233: - I am unable to reproduce your error. Try to run my example, can you

[jira] [Updated] (SPARK-12236) JDBC filter tests all pass if filters are not really pushed down

2015-12-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-12236: - Affects Version/s: 1.6.0 > JDBC filter tests all pass if filters are not really pushed down >

[jira] [Commented] (SPARK-12231) Failed to generate predicate Error when using dropna

2015-12-08 Thread kevin yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048237#comment-15048237 ] kevin yu commented on SPARK-12231: -- Hello Yahsuan: I am looking at this problem now. I can recreate the

[jira] [Assigned] (SPARK-12236) JDBC filter tests all pass if filters are not really pushed down

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12236: Assignee: (was: Apache Spark) > JDBC filter tests all pass if filters are not really

[jira] [Commented] (SPARK-12236) JDBC filter tests all pass if filters are not really pushed down

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048218#comment-15048218 ] Apache Spark commented on SPARK-12236: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-12235) Enhance mutate() to support replace existing columns

2015-12-08 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048217#comment-15048217 ] Sun Rui commented on SPARK-12235: - [~felixcheung]I think so. Is there any more requirement in SPARK-10346

[jira] [Assigned] (SPARK-12236) JDBC filter tests all pass if filters are not really pushed down

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12236: Assignee: Apache Spark > JDBC filter tests all pass if filters are not really pushed down

[jira] [Assigned] (SPARK-12220) Make Utils.fetchFile support files that contain special characters

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12220: Assignee: (was: Apache Spark) > Make Utils.fetchFile support files that contain

[jira] [Assigned] (SPARK-12220) Make Utils.fetchFile support files that contain special characters

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12220: Assignee: Apache Spark > Make Utils.fetchFile support files that contain special

[jira] [Created] (SPARK-12225) Support adding or replacing multiple columns at once in DataFrame API

2015-12-08 Thread Sun Rui (JIRA)
Sun Rui created SPARK-12225: --- Summary: Support adding or replacing multiple columns at once in DataFrame API Key: SPARK-12225 URL: https://issues.apache.org/jira/browse/SPARK-12225 Project: Spark

[jira] [Resolved] (SPARK-12187) *MemoryPool classes should not be public

2015-12-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12187. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10182

[jira] [Comment Edited] (SPARK-9059) Update Python Direct Kafka Word count examples to show the use of HasOffsetRanges

2015-12-08 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047132#comment-15047132 ] Neelesh Srinivas Salian edited comment on SPARK-9059 at 12/8/15 11:15 PM:

[jira] [Created] (SPARK-12220) Make Utils.fetchFile support files that contain special characters

2015-12-08 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-12220: Summary: Make Utils.fetchFile support files that contain special characters Key: SPARK-12220 URL: https://issues.apache.org/jira/browse/SPARK-12220 Project: Spark

[jira] [Commented] (SPARK-9372) For a join operator, rows with null equal join key expression can be filtered out early

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047705#comment-15047705 ] Apache Spark commented on SPARK-9372: - User 'nongli' has created a pull request for this issue:

[jira] [Reopened] (SPARK-9843) Catalyst: Allow adding custom optimizers

2015-12-08 Thread Robert Kruszewski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kruszewski reopened SPARK-9843: -- Made a new PR. Let me know if anyone have feedback > Catalyst: Allow adding custom

[jira] [Created] (SPARK-12222) deserialize RoaringBitmap using Kryo serializer throw Buffer underflow exception

2015-12-08 Thread Fei Wang (JIRA)
Fei Wang created SPARK-1: Summary: deserialize RoaringBitmap using Kryo serializer throw Buffer underflow exception Key: SPARK-1 URL: https://issues.apache.org/jira/browse/SPARK-1 Project:

[jira] [Commented] (SPARK-11965) Update user guide for RFormula feature interactions

2015-12-08 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047894#comment-15047894 ] Yanbo Liang commented on SPARK-11965: - Sure, I can take it. > Update user guide for RFormula feature

[jira] [Commented] (SPARK-12224) R support for JDBC source

2015-12-08 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047878#comment-15047878 ] Sun Rui commented on SPARK-12224: - great > R support for JDBC source > - > >

[jira] [Resolved] (SPARK-12223) Spark 1.5 pre-bulit releases don't work with the java version shipped with Macs

2015-12-08 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-12223. Resolution: Invalid Spark 1.5 requires Java 7. > Spark 1.5 pre-bulit releases don't work

[jira] [Resolved] (SPARK-12069) Documentation update for Datasets

2015-12-08 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12069. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10060

[jira] [Assigned] (SPARK-12221) Add CPU time metric to TaskMetrics

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12221: Assignee: Apache Spark > Add CPU time metric to TaskMetrics >

[jira] [Commented] (SPARK-12224) R support for JDBC source

2015-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047868#comment-15047868 ] Felix Cheung commented on SPARK-12224: -- I'm working on this. > R support for JDBC source >

[jira] [Created] (SPARK-12224) R support for JDBC source

2015-12-08 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12224: Summary: R support for JDBC source Key: SPARK-12224 URL: https://issues.apache.org/jira/browse/SPARK-12224 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-10643) Support HDFS application download in client mode spark submit

2015-12-08 Thread Alan Braithwaite (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Braithwaite updated SPARK-10643: - Summary: Support HDFS application download in client mode spark submit (was: Support

[jira] [Commented] (SPARK-2280) Java & Scala reference docs should describe function reference behavior.

2015-12-08 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047674#comment-15047674 ] Neelesh Srinivas Salian commented on SPARK-2280: [~srowen] , checking to see if this is

[jira] [Commented] (SPARK-12220) Make Utils.fetchFile support files that contain special characters

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047687#comment-15047687 ] Apache Spark commented on SPARK-12220: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Commented] (SPARK-9843) Catalyst: Allow adding custom optimizers

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047721#comment-15047721 ] Apache Spark commented on SPARK-9843: - User 'robert3005' has created a pull request for this issue:

[jira] [Created] (SPARK-12223) Spark 1.5 pre-bulit releases don't work with the java version shipped with Macs

2015-12-08 Thread Dan Adkins (JIRA)
Dan Adkins created SPARK-12223: -- Summary: Spark 1.5 pre-bulit releases don't work with the java version shipped with Macs Key: SPARK-12223 URL: https://issues.apache.org/jira/browse/SPARK-12223 Project:

[jira] [Commented] (SPARK-12221) Add CPU time metric to TaskMetrics

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047813#comment-15047813 ] Apache Spark commented on SPARK-12221: -- User 'jisookim0513' has created a pull request for this

[jira] [Created] (SPARK-12221) Add CPU time metric to TaskMetrics

2015-12-08 Thread Jisoo Kim (JIRA)
Jisoo Kim created SPARK-12221: - Summary: Add CPU time metric to TaskMetrics Key: SPARK-12221 URL: https://issues.apache.org/jira/browse/SPARK-12221 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-12221) Add CPU time metric to TaskMetrics

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12221: Assignee: (was: Apache Spark) > Add CPU time metric to TaskMetrics >

[jira] [Commented] (SPARK-9278) DataFrameWriter.insertInto inserts incorrect data

2015-12-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047830#comment-15047830 ] Hyukjin Kwon commented on SPARK-9278: - The result might be definitely different as I ran the codes

[jira] [Comment Edited] (SPARK-9278) DataFrameWriter.insertInto inserts incorrect data

2015-12-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047830#comment-15047830 ] Hyukjin Kwon edited comment on SPARK-9278 at 12/9/15 1:21 AM: -- The result

[jira] [Commented] (SPARK-12182) Distributed binning for trees in spark.ml

2015-12-08 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047660#comment-15047660 ] Seth Hendrickson commented on SPARK-12182: -- I'm working on this. Following mllib implementation:

[jira] [Commented] (SPARK-11678) Partition discovery fail if there is a _SUCCESS file in the table's root dir

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047791#comment-15047791 ] Apache Spark commented on SPARK-11678: -- User 'yhuai' has created a pull request for this issue:

[jira] [Commented] (SPARK-12218) Boolean logic in sql does not work "not (A and B)" is not the same as "(not A) or (not B)"

2015-12-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047928#comment-15047928 ] Xiao Li commented on SPARK-12218: - Could you provide the plan by explain(true)? [~imachabeli] Thanks! >

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-08 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047962#comment-15047962 ] Tao Li commented on SPARK-12179: Sorry, row_number is udf written by myself, not spark internal udf. Do I

[jira] [Updated] (SPARK-12232) Consider exporting read.table in R

2015-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12232: - Summary: Consider exporting read.table in R (was: Consider exporting in R read.table) >

[jira] [Comment Edited] (SPARK-12232) Consider exporting read.table in R

2015-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048039#comment-15048039 ] Felix Cheung edited comment on SPARK-12232 at 12/9/15 5:22 AM: --- WIP here:

[jira] [Created] (SPARK-12233) Cannot specify a data frame column during join

2015-12-08 Thread Fengdong Yu (JIRA)
Fengdong Yu created SPARK-12233: --- Summary: Cannot specify a data frame column during join Key: SPARK-12233 URL: https://issues.apache.org/jira/browse/SPARK-12233 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-12225) Support adding or replacing multiple columns at once in DataFrame API

2015-12-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048059#comment-15048059 ] Xiao Li edited comment on SPARK-12225 at 12/9/15 5:21 AM: -- This is related to

[jira] [Commented] (SPARK-12233) Cannot specify a data frame column during join

2015-12-08 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048079#comment-15048079 ] holdenk commented on SPARK-12233: - Could you maybe so what happens with the "wrong" example? Also it

[jira] [Commented] (SPARK-6929) Alias for more complex expression causes attribute not been able to resolve

2015-12-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048098#comment-15048098 ] Xiao Li commented on SPARK-6929: [~srowen] Could you close this issue? This has been resolved, I think.

[jira] [Updated] (SPARK-12234) SparkR subset throw error when only set "select" argument

2015-12-08 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12234: Description: SparkR subset function throw error when only set "select" argument, it's easy to

[jira] [Updated] (SPARK-12234) SparkR subset throw error when only set "select" argument

2015-12-08 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12234: Description: SparkR subset throw error when only set "select" argument, it's easy to repreduce.

[jira] [Commented] (SPARK-9059) Update Python Direct Kafka Word count examples to show the use of HasOffsetRanges

2015-12-08 Thread Benjamin Fradet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048177#comment-15048177 ] Benjamin Fradet commented on SPARK-9059: Hi [~neelesh77], I know the documentation has been

[jira] [Commented] (SPARK-8517) Improve the organization and style of MLlib's user guide

2015-12-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047905#comment-15047905 ] Joseph K. Bradley commented on SPARK-8517: -- I merged this PR, but am leaving the JIRA open since

[jira] [Commented] (SPARK-12225) Support adding or replacing multiple columns at once in DataFrame API

2015-12-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047934#comment-15047934 ] Xiao Li commented on SPARK-12225: - Ok, thank you! > Support adding or replacing multiple columns at

[jira] [Commented] (SPARK-12225) Support adding or replacing multiple columns at once in DataFrame API

2015-12-08 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047930#comment-15047930 ] Sun Rui commented on SPARK-12225: - No. Go ahead if you are interested > Support adding or replacing

[jira] [Assigned] (SPARK-12228) Use in-memory for execution hive's derby metastore

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12228: Assignee: Apache Spark (was: Yin Huai) > Use in-memory for execution hive's derby

[jira] [Created] (SPARK-12228) Use in-memory for execution hive's derby metastore

2015-12-08 Thread Yin Huai (JIRA)
Yin Huai created SPARK-12228: Summary: Use in-memory for execution hive's derby metastore Key: SPARK-12228 URL: https://issues.apache.org/jira/browse/SPARK-12228 Project: Spark Issue Type:

[jira] [Commented] (SPARK-12228) Use in-memory for execution hive's derby metastore

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047954#comment-15047954 ] Apache Spark commented on SPARK-12228: -- User 'yhuai' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12228) Use in-memory for execution hive's derby metastore

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12228: Assignee: Yin Huai (was: Apache Spark) > Use in-memory for execution hive's derby

[jira] [Commented] (SPARK-12230) WeightedLeastSquares.fit() should handle division by zero properly if standard deviation of target variable is zero.

2015-12-08 Thread Imran Younus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047985#comment-15047985 ] Imran Younus commented on SPARK-12230: -- I can work on this. > WeightedLeastSquares.fit() should

[jira] [Commented] (SPARK-12164) [SQL] Display the binary/encoded values

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047997#comment-15047997 ] Apache Spark commented on SPARK-12164: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Resolved] (SPARK-12222) deserialize RoaringBitmap using Kryo serializer throw Buffer underflow exception

2015-12-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-1. Resolution: Fixed Fix Version/s: 1.6.0 2.0.0 Issue resolved by pull

[jira] [Comment Edited] (SPARK-12233) Cannot specify a data frame column during join

2015-12-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048096#comment-15048096 ] Xiao Li edited comment on SPARK-12233 at 12/9/15 6:00 AM: -- This is another self

[jira] [Created] (SPARK-12234) SparkR subset throw error when only set "select" argument

2015-12-08 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12234: --- Summary: SparkR subset throw error when only set "select" argument Key: SPARK-12234 URL: https://issues.apache.org/jira/browse/SPARK-12234 Project: Spark

[jira] [Assigned] (SPARK-12234) SparkR subset throw error when only set "select" argument

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12234: Assignee: (was: Apache Spark) > SparkR subset throw error when only set "select"

[jira] [Commented] (SPARK-12234) SparkR subset throw error when only set "select" argument

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048139#comment-15048139 ] Apache Spark commented on SPARK-12234: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12234) SparkR subset throw error when only set "select" argument

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12234: Assignee: Apache Spark > SparkR subset throw error when only set "select" argument >

[jira] [Comment Edited] (SPARK-12179) Spark SQL get different result with the same code

2015-12-08 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047965#comment-15047965 ] Tao Li edited comment on SPARK-12179 at 12/9/15 6:56 AM: - The row_number

[jira] [Created] (SPARK-12236) JDBC filter tests all pass if filters are not really pushed down

2015-12-08 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-12236: Summary: JDBC filter tests all pass if filters are not really pushed down Key: SPARK-12236 URL: https://issues.apache.org/jira/browse/SPARK-12236 Project: Spark

[jira] [Commented] (SPARK-12225) Support adding or replacing multiple columns at once in DataFrame API

2015-12-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047922#comment-15047922 ] Xiao Li commented on SPARK-12225: - [~sunrui] Will you deliver the feature? Otherwise, I can work on it.

[jira] [Created] (SPARK-12227) Support drop multiple columns specified by Column class in DataFrame API

2015-12-08 Thread Sun Rui (JIRA)
Sun Rui created SPARK-12227: --- Summary: Support drop multiple columns specified by Column class in DataFrame API Key: SPARK-12227 URL: https://issues.apache.org/jira/browse/SPARK-12227 Project: Spark

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-08 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047938#comment-15047938 ] Tao Li commented on SPARK-12179: ok, i will try on it > Spark SQL get different result with the same

[jira] [Commented] (SPARK-12225) Support adding or replacing multiple columns at once in DataFrame API

2015-12-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048059#comment-15048059 ] Xiao Li commented on SPARK-12225: - This is related to the changes on the external APIs. Need to collect

[jira] [Updated] (SPARK-12233) Cannot specify a data frame column during join

2015-12-08 Thread Fengdong Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengdong Yu updated SPARK-12233: Description: {code} sqlContext.udf.register("lowercase", (s: String) =>{ if

[jira] [Updated] (SPARK-12233) Cannot specify a data frame column during join

2015-12-08 Thread Fengdong Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengdong Yu updated SPARK-12233: Description: {code} sqlContext.udf.register("lowercase", (s: String) =>{ if

[jira] [Commented] (SPARK-12227) Support drop multiple columns specified by Column class in DataFrame API

2015-12-08 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048126#comment-15048126 ] Sun Rui commented on SPARK-12227: - [~hyukjin.kwon] sure > Support drop multiple columns specified by

[jira] [Updated] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2015-12-08 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-3200: --- Description: Reproducer: {noformat} val a = sc.textFile("README.md").count case class A(i:

[jira] [Comment Edited] (SPARK-12232) Consider exporting read.table in R

2015-12-08 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048189#comment-15048189 ] Yanbo Liang edited comment on SPARK-12232 at 12/9/15 7:18 AM: -- I vote for do

[jira] [Commented] (SPARK-12232) Consider exporting read.table in R

2015-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048039#comment-15048039 ] Felix Cheung commented on SPARK-12232: -- WIP here:

[jira] [Updated] (SPARK-12233) Cannot specify a data frame column during join

2015-12-08 Thread Fengdong Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengdong Yu updated SPARK-12233: Description: {code} sqlContext.udf.register("lowercase", (s: String) =>{ if

[jira] [Commented] (SPARK-12233) Cannot specify a data frame column during join

2015-12-08 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048087#comment-15048087 ] Xiao Li commented on SPARK-12233: - Please post the error message you got. Thanks! > Cannot specify a

[jira] [Commented] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2015-12-08 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048128#comment-15048128 ] Prashant Sharma commented on SPARK-3200: [~srowen] Reproducer is intended for distributed mode, I

[jira] [Closed] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2015-12-08 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma closed SPARK-3200. -- Resolution: Not A Problem > Class defined with reference to external variables crashes in REPL.

[jira] [Reopened] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2015-12-08 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma reopened SPARK-3200: > Class defined with reference to external variables crashes in REPL. >

[jira] [Assigned] (SPARK-12227) Support drop multiple columns specified by Column class in DataFrame API

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12227: Assignee: (was: Apache Spark) > Support drop multiple columns specified by Column

[jira] [Commented] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2015-12-08 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048144#comment-15048144 ] Prashant Sharma commented on SPARK-3200: However, the good part is no one actually ran into this

[jira] [Assigned] (SPARK-12227) Support drop multiple columns specified by Column class in DataFrame API

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12227: Assignee: Apache Spark > Support drop multiple columns specified by Column class in

[jira] [Commented] (SPARK-12227) Support drop multiple columns specified by Column class in DataFrame API

2015-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048146#comment-15048146 ] Apache Spark commented on SPARK-12227: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-12232) Consider exporting read.table in R

2015-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048195#comment-15048195 ] Felix Cheung commented on SPARK-12232: -- right, but then table() is confusing as well. R's notion of

[jira] [Commented] (SPARK-12236) JDBC filter tests all pass if filters are not really pushed down

2015-12-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048199#comment-15048199 ] Hyukjin Kwon commented on SPARK-12236: -- I would like to work on this. > JDBC filter tests all pass

<    1   2   3   >