[jira] [Resolved] (SPARK-14883) Fix wrong R examples and make them up-to-date

2016-04-24 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-14883. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-14594) Improve error messages for RDD API

2016-04-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-14594. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-14594) Improve error messages for RDD API

2016-04-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-14594: -- Assignee: Felix Cheung > Improve error messages for RDD API >

[jira] [Commented] (SPARK-6817) DataFrame UDFs in R

2016-04-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264954#comment-15264954 ] Shivaram Venkataraman commented on SPARK-6817: -- I just merged

[jira] [Updated] (SPARK-12919) Implement dapply() on DataFrame in SparkR

2016-04-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12919: -- Assignee: Sun Rui > Implement dapply() on DataFrame in SparkR >

[jira] [Resolved] (SPARK-12919) Implement dapply() on DataFrame in SparkR

2016-04-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12919. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-10894) Add 'drop' support for DataFrame's subset function

2016-04-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10894. --- Resolution: Fixed > Add 'drop' support for DataFrame's subset function >

[jira] [Resolved] (SPARK-10346) SparkR mutate and transform should replace column with same name to match R data.frame behavior

2016-04-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10346. --- Resolution: Fixed > SparkR mutate and transform should replace column with

[jira] [Updated] (SPARK-12235) Enhance mutate() to support replace existing columns

2016-04-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12235: -- Assignee: Sun Rui > Enhance mutate() to support replace existing columns >

[jira] [Resolved] (SPARK-12235) Enhance mutate() to support replace existing columns

2016-04-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12235. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-6817) DataFrame UDFs in R

2016-04-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6817: - Target Version/s: 2.0.0 > DataFrame UDFs in R > --- > >

[jira] [Commented] (SPARK-14995) Add "since" tag in Roxygen documentation for SparkR API methods

2016-04-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263549#comment-15263549 ] Shivaram Venkataraman commented on SPARK-14995: --- We could just use one of the existing

[jira] [Commented] (SPARK-14831) Make ML APIs in SparkR consistent

2016-04-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254447#comment-15254447 ] Shivaram Venkataraman commented on SPARK-14831: --- Yeah I think there are a couple of factors

[jira] [Commented] (SPARK-14831) Make ML APIs in SparkR consistent

2016-04-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254551#comment-15254551 ] Shivaram Venkataraman commented on SPARK-14831: --- 1. Agree. I think a valid policy could be

[jira] [Commented] (SPARK-15294) Add pivot functionality to SparkR

2016-05-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297146#comment-15297146 ] Shivaram Venkataraman commented on SPARK-15294: --- [~mhnatiuk] I think the code diff looks

[jira] [Commented] (SPARK-13525) SparkR: java.net.SocketTimeoutException: Accept timed out when running any dataframe function

2016-05-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297159#comment-15297159 ] Shivaram Venkataraman commented on SPARK-13525: --- If the problem is on line 353 it means

[jira] [Commented] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2016-05-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297162#comment-15297162 ] Shivaram Venkataraman commented on SPARK-12071: --- [~KrishnaKalyan3] Feel free to work on

[jira] [Commented] (SPARK-15439) Failed to run unit test in SparkR

2016-05-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297176#comment-15297176 ] Shivaram Venkataraman commented on SPARK-15439: --- [~wm624] Any luck in figuring out why this

[jira] [Commented] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2016-05-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297245#comment-15297245 ] Shivaram Venkataraman commented on SPARK-12071: --- You can add it under the migration guide

[jira] [Commented] (SPARK-15439) Failed to run unit test in SparkR

2016-05-24 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298579#comment-15298579 ] Shivaram Venkataraman commented on SPARK-15439: --- I think the `maskedCompletely` failures

[jira] [Commented] (SPARK-14995) Add "since" tag in Roxygen documentation for SparkR API methods

2016-05-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281746#comment-15281746 ] Shivaram Venkataraman commented on SPARK-14995: --- Technically entire SparkR component is

[jira] [Commented] (SPARK-14751) SparkR fails on Cassandra map with numeric key

2016-05-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281700#comment-15281700 ] Shivaram Venkataraman commented on SPARK-14751: --- [~sunrui] That sounds fine to me. Can we

[jira] [Commented] (SPARK-15294) Add pivot functionality to SparkR

2016-05-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281807#comment-15281807 ] Shivaram Venkataraman commented on SPARK-15294: --- [~mhnatiuk] Thanks for opening this. I

[jira] [Updated] (SPARK-15202) add dapplyCollect() method for DataFrame in SparkR

2016-05-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-15202: -- Assignee: Sun Rui > add dapplyCollect() method for DataFrame in SparkR >

[jira] [Resolved] (SPARK-15202) add dapplyCollect() method for DataFrame in SparkR

2016-05-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15202. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-11395) Support over and window specification in SparkR

2016-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11395. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 2.0.0

[jira] [Commented] (SPARK-10043) Add window functions into SparkR

2016-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273475#comment-15273475 ] Shivaram Venkataraman commented on SPARK-10043: --- [~sunrui] Can we resolve this issue now ?

[jira] [Commented] (SPARK-15159) Remove usage of HiveContext in SparkR.

2016-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273396#comment-15273396 ] Shivaram Venkataraman commented on SPARK-15159: --- Is it being removed or is it being

[jira] [Resolved] (SPARK-15091) Fix warnings and a failure in SparkR test cases with testthat version 1.0.1

2016-05-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15091. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 2.0.0

[jira] [Commented] (SPARK-14692) Error While Setting the path for R front end

2016-04-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248363#comment-15248363 ] Shivaram Venkataraman commented on SPARK-14692: --- I think SparkR might not have been built ?

[jira] [Commented] (SPARK-14325) some strange name conflicts in `group_by`

2016-04-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248374#comment-15248374 ] Shivaram Venkataraman commented on SPARK-14325: --- I think the problem might be related to

[jira] [Commented] (SPARK-14594) Improve error messages for RDD API

2016-04-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248392#comment-15248392 ] Shivaram Venkataraman commented on SPARK-14594: --- I think this would be very useful to have

[jira] [Commented] (SPARK-14326) Can't specify "long" type in structField

2016-04-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248335#comment-15248335 ] Shivaram Venkataraman commented on SPARK-14326: --- I think its fine to support this in

[jira] [Commented] (SPARK-14037) count(df) is very slow for dataframe constrcuted using SparkR::createDataFrame

2016-04-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248416#comment-15248416 ] Shivaram Venkataraman commented on SPARK-14037: --- Thanks [~samalexg] and [~sunrui] for

[jira] [Resolved] (SPARK-13905) Change signature of as.data.frame() to be consistent with the R base package

2016-04-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-13905. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 2.0.0

[jira] [Resolved] (SPARK-12224) R support for JDBC source

2016-04-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12224. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-12224) R support for JDBC source

2016-04-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12224: -- Assignee: Felix Cheung (was: Apache Spark) > R support for JDBC source >

[jira] [Commented] (SPARK-14746) Support transformations in R source code for Dataset/DataFrame

2016-04-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250229#comment-15250229 ] Shivaram Venkataraman commented on SPARK-14746: --- Yeah I can see that RDD pipe is limited

[jira] [Commented] (SPARK-14742) Redirect spark-ec2 doc to new location

2016-04-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250216#comment-15250216 ] Shivaram Venkataraman commented on SPARK-14742: --- Ah my bad - I forgot that docs/ is

[jira] [Commented] (SPARK-13178) RRDD faces with concurrency issue in case of rdd.zip(rdd).count()

2016-04-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250268#comment-15250268 ] Shivaram Venkataraman commented on SPARK-13178: --- [~sunrui] [~yinxusen] Now that

[jira] [Commented] (SPARK-14751) SparkR fails on Cassandra map with numeric key

2016-04-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250385#comment-15250385 ] Shivaram Venkataraman commented on SPARK-14751: --- I think the problem here is that map types

[jira] [Updated] (SPARK-12479) sparkR collect on GroupedData throws R error "missing value where TRUE/FALSE needed"

2016-05-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12479: -- Assignee: Sun Rui > sparkR collect on GroupedData throws R error "missing

[jira] [Resolved] (SPARK-12479) sparkR collect on GroupedData throws R error "missing value where TRUE/FALSE needed"

2016-05-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12479. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Commented] (SPARK-12661) Drop Python 2.6 support in PySpark

2016-05-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277473#comment-15277473 ] Shivaram Venkataraman commented on SPARK-12661: --- Yes - We will do a full round of AMI

[jira] [Created] (SPARK-16509) Rename window.partitionBy and window.orderBy

2016-07-12 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-16509: - Summary: Rename window.partitionBy and window.orderBy Key: SPARK-16509 URL: https://issues.apache.org/jira/browse/SPARK-16509 Project: Spark

[jira] [Created] (SPARK-16508) Fix documentation warnings found by R CMD check

2016-07-12 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-16508: - Summary: Fix documentation warnings found by R CMD check Key: SPARK-16508 URL: https://issues.apache.org/jira/browse/SPARK-16508 Project: Spark

[jira] [Updated] (SPARK-16507) Add CRAN checks to SparkR

2016-07-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16507: -- Assignee: Shivaram Venkataraman > Add CRAN checks to SparkR >

[jira] [Created] (SPARK-16507) Add CRAN checks to SparkR

2016-07-12 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-16507: - Summary: Add CRAN checks to SparkR Key: SPARK-16507 URL: https://issues.apache.org/jira/browse/SPARK-16507 Project: Spark Issue Type:

[jira] [Created] (SPARK-16510) Move SparkR test JAR into Spark, include its source code

2016-07-12 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-16510: - Summary: Move SparkR test JAR into Spark, include its source code Key: SPARK-16510 URL: https://issues.apache.org/jira/browse/SPARK-16510 Project:

[jira] [Commented] (SPARK-16468) Confusing results when describe() used on DataFrame with chr columns

2016-07-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373914#comment-15373914 ] Shivaram Venkataraman commented on SPARK-16468: --- [~dongjoon] [~n...@dewar-us.com] Is there

[jira] [Updated] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16538: -- Assignee: Felix Cheung > Cannot use "SparkR::sql" > >

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-07-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377343#comment-15377343 ] Shivaram Venkataraman commented on SPARK-15799: --- I have written a design doc capturing the

[jira] [Resolved] (SPARK-16509) Rename window.partitionBy and window.orderBy

2016-07-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16509. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-07-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377347#comment-15377347 ] Shivaram Venkataraman commented on SPARK-15799: --- cc [~javierluraschi] [~j...@rstudio.com]

[jira] [Resolved] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16538. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Updated] (SPARK-16509) Rename window.partitionBy and window.orderBy

2016-07-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16509: -- Assignee: Sun Rui > Rename window.partitionBy and window.orderBy >

[jira] [Created] (SPARK-16553) Typo in Spark SQL Programming guide that links to examples

2016-07-14 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-16553: - Summary: Typo in Spark SQL Programming guide that links to examples Key: SPARK-16553 URL: https://issues.apache.org/jira/browse/SPARK-16553 Project:

[jira] [Commented] (SPARK-16693) Remove R deprecated methods

2016-07-25 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392484#comment-15392484 ] Shivaram Venkataraman commented on SPARK-16693: --- Yeah lets hold off on this for now. For

[jira] [Commented] (SPARK-16611) Expose several hidden DataFrame/RDD functions

2016-07-25 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392493#comment-15392493 ] Shivaram Venkataraman commented on SPARK-16611: --- [~adrian555] dapply on DataFrames should

[jira] [Commented] (SPARK-16611) Expose several hidden DataFrame/RDD functions

2016-07-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397827#comment-15397827 ] Shivaram Venkataraman commented on SPARK-16611: --- 1. lapply: From an API perspective we can

[jira] [Commented] (SPARK-16519) Handle SparkR RDD generics that create warnings in R CMD check

2016-08-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15417592#comment-15417592 ] Shivaram Venkataraman commented on SPARK-16519: --- Yeah I think the simplest thing to do is

[jira] [Commented] (SPARK-16577) Add check-cran script to Jenkins

2016-08-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15417595#comment-15417595 ] Shivaram Venkataraman commented on SPARK-16577: --- Good point - Let me check this with

[jira] [Resolved] (SPARK-16710) SparkR spark.glm should support weightCol

2016-08-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16710. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request

[jira] [Commented] (SPARK-16883) SQL decimal type is not properly cast to number when collecting SparkDataFrame

2016-08-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414422#comment-15414422 ] Shivaram Venkataraman commented on SPARK-16883: --- Hmm why do we want to serialize it as a

[jira] [Commented] (SPARK-16883) SQL decimal type is not properly cast to number when collecting SparkDataFrame

2016-08-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414446#comment-15414446 ] Shivaram Venkataraman commented on SPARK-16883: --- Yeah I see that - The change I am

[jira] [Commented] (SPARK-16519) Handle SparkR RDD generics that create warnings in R CMD check

2016-08-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15419762#comment-15419762 ] Shivaram Venkataraman commented on SPARK-16519: --- FYI [~aloknsingh] [~clarkfitzg] some of

[jira] [Resolved] (SPARK-16579) Add a spark install function

2016-08-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16579. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Commented] (SPARK-16510) Move SparkR test JAR into Spark, include its source code

2016-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376010#comment-15376010 ] Shivaram Venkataraman commented on SPARK-16510: --- For (a) the assumption is that we will be

[jira] [Commented] (SPARK-16509) Rename window.partitionBy and window.orderBy

2016-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376019#comment-15376019 ] Shivaram Venkataraman commented on SPARK-16509: --- Thats good to know -- [~felixcheung] Can

[jira] [Commented] (SPARK-16509) Rename window.partitionBy and window.orderBy

2016-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374450#comment-15374450 ] Shivaram Venkataraman commented on SPARK-16509: --- Sounds good to me. Also was this

[jira] [Created] (SPARK-16519) Handle SparkR RDD generics that create warnings in R CMD check

2016-07-13 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-16519: - Summary: Handle SparkR RDD generics that create warnings in R CMD check Key: SPARK-16519 URL: https://issues.apache.org/jira/browse/SPARK-16519

[jira] [Commented] (SPARK-15124) R 2.0 QA: New R APIs and API docs

2016-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375672#comment-15375672 ] Shivaram Venkataraman commented on SPARK-15124: --- I think we covered everything here in

[jira] [Updated] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16538: -- Priority: Critical (was: Major) > Cannot use "SparkR::sql" >

[jira] [Commented] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376225#comment-15376225 ] Shivaram Venkataraman commented on SPARK-16538: --- This also affects other functions like

[jira] [Comment Edited] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376225#comment-15376225 ] Shivaram Venkataraman edited comment on SPARK-16538 at 7/14/16 3:15 AM:

[jira] [Commented] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376244#comment-15376244 ] Shivaram Venkataraman commented on SPARK-16538: --- So it looks like what is going on is that

[jira] [Commented] (SPARK-16611) Expose several hidden DataFrame/RDD functions

2016-07-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383050#comment-15383050 ] Shivaram Venkataraman commented on SPARK-16611: --- I think its a bit different as SPARK-16581

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-07-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15382658#comment-15382658 ] Shivaram Venkataraman commented on SPARK-15799: --- Yeah - so the assumption is that the user

[jira] [Commented] (SPARK-14816) Update MLlib, GraphX, SparkR websites for 2.0

2016-07-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15382684#comment-15382684 ] Shivaram Venkataraman commented on SPARK-14816: --- Yeah I'm fine with spending more effort on

[jira] [Updated] (SPARK-16055) sparkR.init() can not load sparkPackages when executing an R file

2016-07-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16055: -- Assignee: Krishna Kalyan > sparkR.init() can not load sparkPackages when

[jira] [Resolved] (SPARK-16055) sparkR.init() can not load sparkPackages when executing an R file

2016-07-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16055. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Commented] (SPARK-16581) Making JVM backend calling functions public

2016-07-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15382812#comment-15382812 ] Shivaram Venkataraman commented on SPARK-16581: --- Importing comment from SPARK-16608 {code}

[jira] [Resolved] (SPARK-16608) Expose JVM SparkR API functions

2016-07-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16608. --- Resolution: Duplicate > Expose JVM SparkR API functions >

[jira] [Commented] (SPARK-16608) Expose JVM SparkR API functions

2016-07-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15382810#comment-15382810 ] Shivaram Venkataraman commented on SPARK-16608: --- [~olarayej] I'm marking this as duplicate

[jira] [Commented] (SPARK-14816) Update MLlib, GraphX, SparkR websites for 2.0

2016-07-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15381506#comment-15381506 ] Shivaram Venkataraman commented on SPARK-14816: --- We didn't create a website for SparkR as

[jira] [Commented] (SPARK-16510) Move SparkR test JAR into Spark, include its source code

2016-07-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15381580#comment-15381580 ] Shivaram Venkataraman commented on SPARK-16510: --- I actually found a better way to do this

[jira] [Assigned] (SPARK-16510) Move SparkR test JAR into Spark, include its source code

2016-07-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-16510: - Assignee: Shivaram Venkataraman > Move SparkR test JAR into Spark,

[jira] [Updated] (SPARK-16027) Fix SparkR session unit test

2016-07-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16027: -- Assignee: Felix Cheung (was: Apache Spark) > Fix SparkR session unit test >

[jira] [Resolved] (SPARK-16027) Fix SparkR session unit test

2016-07-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16027. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-16507) Add CRAN checks to SparkR

2016-07-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16507. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Assigned] (SPARK-16507) Add CRAN checks to SparkR

2016-07-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-16507: - Assignee: Shivaram Venkataraman (was: Apache Spark) > Add CRAN checks

[jira] [Resolved] (SPARK-16112) R programming guide update for gapply and gapplyCollect

2016-07-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16112. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Updated] (SPARK-16112) R programming guide update for gapply and gapplyCollect

2016-07-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16112: -- Assignee: Narine Kokhlikyan > R programming guide update for gapply and

[jira] [Commented] (SPARK-16464) withColumn() allows illegal creation of duplicate column names on DataFrame

2016-07-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384491#comment-15384491 ] Shivaram Venkataraman commented on SPARK-16464: --- I guess the question then is should we

[jira] [Commented] (SPARK-16581) Making JVM backend calling functions public

2016-07-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384508#comment-15384508 ] Shivaram Venkataraman commented on SPARK-16581: --- I agree that `invokeJava` is too low

[jira] [Assigned] (SPARK-10683) Source code missing for SparkR test JAR

2016-07-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-10683: - Assignee: Shivaram Venkataraman > Source code missing for SparkR test

[jira] [Resolved] (SPARK-16510) Move SparkR test JAR into Spark, include its source code

2016-07-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16510. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Resolved] (SPARK-10683) Source code missing for SparkR test JAR

2016-07-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10683. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Commented] (SPARK-16464) withColumn() allows illegal creation of duplicate column names on DataFrame

2016-07-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15385263#comment-15385263 ] Shivaram Venkataraman commented on SPARK-16464: --- Thanks [~proflin] for checking this. In

[jira] [Commented] (SPARK-16579) Add a spark install function

2016-07-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384725#comment-15384725 ] Shivaram Venkataraman commented on SPARK-16579: --- Yeah - i think we want to put Spark in the

<    5   6   7   8   9   10   11   12   13   >