[jira] [Created] (SPARK-16508) Fix documentation warnings found by R CMD check

2016-07-12 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-16508: - Summary: Fix documentation warnings found by R CMD check Key: SPARK-16508 URL: https://issues.apache.org/jira/browse/SPARK-16508 Project: Spark

[jira] [Updated] (SPARK-16507) Add CRAN checks to SparkR

2016-07-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16507: -- Assignee: Shivaram Venkataraman > Add CRAN checks to SparkR >

[jira] [Created] (SPARK-16507) Add CRAN checks to SparkR

2016-07-12 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-16507: - Summary: Add CRAN checks to SparkR Key: SPARK-16507 URL: https://issues.apache.org/jira/browse/SPARK-16507 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-07-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16144. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Commented] (SPARK-16468) Confusing results when describe() used on DataFrame with chr columns

2016-07-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371188#comment-15371188 ] Shivaram Venkataraman commented on SPARK-16468: --- Are the character columns problem fixed by

[jira] [Commented] (SPARK-16055) sparkR.init() can not load sparkPackages when executing an R file

2016-07-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371163#comment-15371163 ] Shivaram Venkataraman commented on SPARK-16055: --- The if condition at

[jira] [Commented] (SPARK-6089) Size of task result fetched can't be found in UI

2016-07-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371156#comment-15371156 ] Shivaram Venkataraman commented on SPARK-6089: -- You can check some of the PRs that added or

[jira] [Commented] (SPARK-15767) Decision Tree Regression wrapper in SparkR

2016-07-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368594#comment-15368594 ] Shivaram Venkataraman commented on SPARK-15767: --- Sorry I missed this thread. I agree with

[jira] [Commented] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368546#comment-15368546 ] Shivaram Venkataraman commented on SPARK-16437: --- FWIW this also happens with Scala (i.e.

[jira] [Updated] (SPARK-16425) SparkR summary() fails on column of type logical

2016-07-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16425: -- Assignee: Dongjoon Hyun > SparkR summary() fails on column of type logical >

[jira] [Resolved] (SPARK-16425) SparkR summary() fails on column of type logical

2016-07-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16425. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Updated] (SPARK-16310) SparkR csv source should have the same default na.string as R

2016-07-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16310: -- Fix Version/s: 2.1.0 > SparkR csv source should have the same default

[jira] [Updated] (SPARK-16310) SparkR csv source should have the same default na.string as R

2016-07-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16310: -- Assignee: Felix Cheung > SparkR csv source should have the same default

[jira] [Resolved] (SPARK-16310) SparkR csv source should have the same default na.string as R

2016-07-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16310. --- Resolution: Fixed Fix Version/s: 2.0.1 Issue resolved by pull request

[jira] [Commented] (SPARK-16258) Automatically append the grouping keys in SparkR's gapply

2016-07-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15359794#comment-15359794 ] Shivaram Venkataraman commented on SPARK-16258: --- Thanks [~timhunter] -- So I see two ways

[jira] [Updated] (SPARK-16233) test_sparkSQL.R is failing

2016-07-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16233: -- Assignee: Dongjoon Hyun > test_sparkSQL.R is failing >

[jira] [Resolved] (SPARK-16233) test_sparkSQL.R is failing

2016-07-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16233. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-16299) Capture errors from R workers in daemon.R to avoid deletion of R session temporary directory

2016-07-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16299. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-16299) Capture errors from R workers in daemon.R to avoid deletion of R session temporary directory

2016-07-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16299: -- Assignee: Sun Rui (was: Apache Spark) > Capture errors from R workers in

[jira] [Commented] (SPARK-16055) sparkR.init() can not load sparkPackages when executing an R file

2016-07-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15359672#comment-15359672 ] Shivaram Venkataraman commented on SPARK-16055: --- I think the issue doesn't come up when you

[jira] [Commented] (SPARK-16233) test_sparkSQL.R is failing

2016-07-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15359661#comment-15359661 ] Shivaram Venkataraman commented on SPARK-16233: --- [~dongjoon] Thanks for taking a look. Can

[jira] [Updated] (SPARK-16012) add gapplyCollect() for SparkDataFrame

2016-07-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16012: -- Assignee: Narine Kokhlikyan > add gapplyCollect() for SparkDataFrame >

[jira] [Resolved] (SPARK-16012) add gapplyCollect() for SparkDataFrame

2016-07-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16012. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Commented] (SPARK-16233) test_sparkSQL.R is failing

2016-06-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15353344#comment-15353344 ] Shivaram Venkataraman commented on SPARK-16233: --- Ideally we should skip the tests which

[jira] [Resolved] (SPARK-16184) Support SparkSession.conf API in SparkR

2016-06-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16184. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-16184) Support SparkSession.conf API in SparkR

2016-06-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16184: -- Assignee: Felix Cheung > Support SparkSession.conf API in SparkR >

[jira] [Commented] (SPARK-16112) R programming guide update for gapply

2016-06-24 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15348480#comment-15348480 ] Shivaram Venkataraman commented on SPARK-16112: --- Feel free to include both -- I'll make

[jira] [Resolved] (SPARK-16088) Update setJobGroup, clearJobGroup, cancelJobGroup SparkR API to not require sc

2016-06-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16088. --- Resolution: Fixed Fix Version/s: 2.0.1 Issue resolved by pull request

[jira] [Updated] (SPARK-16088) Update setJobGroup, clearJobGroup, cancelJobGroup SparkR API to not require sc

2016-06-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16088: -- Assignee: Felix Cheung > Update setJobGroup, clearJobGroup, cancelJobGroup

[jira] [Commented] (SPARK-16055) sparkR.init() can not load sparkPackages when executing an R file

2016-06-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346708#comment-15346708 ] Shivaram Venkataraman commented on SPARK-16055: --- Thanks [~KrishnaKalyan3] -- Feel free to

[jira] [Commented] (SPARK-12172) Consider removing SparkR internal RDD APIs

2016-06-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344754#comment-15344754 ] Shivaram Venkataraman commented on SPARK-12172: --- Yeah thats a good point - We will need to

[jira] [Commented] (SPARK-12173) Consider supporting DataSet API in SparkR

2016-06-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344744#comment-15344744 ] Shivaram Venkataraman commented on SPARK-12173: --- Instead of starting with the goal as

[jira] [Resolved] (SPARK-16096) R deprecate unionAll and add union

2016-06-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16096. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-16096) R deprecate unionAll and add union

2016-06-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16096: -- Assignee: Felix Cheung > R deprecate unionAll and add union >

[jira] [Commented] (SPARK-16088) Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342411#comment-15342411 ] Shivaram Venkataraman commented on SPARK-16088: --- In that case lets do the parameter

[jira] [Resolved] (SPARK-16109) Separate out statfunctions in generated R doc

2016-06-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16109. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Commented] (SPARK-16088) Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342269#comment-15342269 ] Shivaram Venkataraman commented on SPARK-16088: --- Yeah this is a good question - The one

[jira] [Updated] (SPARK-16109) Separate out statfunctions in generated R doc

2016-06-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16109: -- Assignee: Felix Cheung > Separate out statfunctions in generated R doc >

[jira] [Created] (SPARK-16109) Separate out statfunctions in generated R doc

2016-06-21 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-16109: - Summary: Separate out statfunctions in generated R doc Key: SPARK-16109 URL: https://issues.apache.org/jira/browse/SPARK-16109 Project: Spark

[jira] [Updated] (SPARK-16082) Refactor dapply's/dapplyCollect's documentation - remove duplicated comments

2016-06-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16082: -- Assignee: Narine Kokhlikyan > Refactor dapply's/dapplyCollect's documentation

[jira] [Resolved] (SPARK-16082) Refactor dapply's/dapplyCollect's documentation - remove duplicated comments

2016-06-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16082. --- Resolution: Fixed Fix Version/s: 2.0.0 Resolved by

[jira] [Resolved] (SPARK-15319) Fix SparkR doc layout for corr and other DataFrame stats functions

2016-06-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15319. --- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.0.0

[jira] [Commented] (SPARK-16088) Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341142#comment-15341142 ] Shivaram Venkataraman commented on SPARK-16088: --- Why don't we convert these also to the

[jira] [Resolved] (SPARK-15294) Add pivot functionality to SparkR

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15294. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s:

[jira] [Resolved] (SPARK-6836) RDD APIs missing in SparkR

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6836. -- Resolution: Won't Fix Marking this as resolved as the RDD API is no longer

[jira] [Resolved] (SPARK-12144) Support more external data source API in SparkR

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12144. --- Resolution: Fixed Fix Version/s: 1.6.0 Resolving the umbrella as

[jira] [Resolved] (SPARK-14995) Add "since" tag in Roxygen documentation for SparkR API methods

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-14995. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s:

[jira] [Updated] (SPARK-16053) Add `spark_partition_id` in SparkR

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16053: -- Assignee: Dongjoon Hyun > Add `spark_partition_id` in SparkR >

[jira] [Resolved] (SPARK-16053) Add `spark_partition_id` in SparkR

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16053. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-16028) Remove the need to pass in a SparkContext for spark.lapply

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16028: -- Assignee: Felix Cheung > Remove the need to pass in a SparkContext for

[jira] [Resolved] (SPARK-16028) Remove the need to pass in a SparkContext for spark.lapply

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16028. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-16051) Add `read.orc/write.orc` to SparkR

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16051: -- Assignee: Dongjoon Hyun > Add `read.orc/write.orc` to SparkR >

[jira] [Resolved] (SPARK-16051) Add `read.orc/write.orc` to SparkR

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16051. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-16029) Deprecate dropTempTable in SparkR

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16029. --- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.0.0

[jira] [Updated] (SPARK-16059) Add `monotonically_increasing_id` function in SparkR

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16059: -- Assignee: Dongjoon Hyun > Add `monotonically_increasing_id` function in SparkR

[jira] [Resolved] (SPARK-16059) Add `monotonically_increasing_id` function in SparkR

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16059. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Commented] (SPARK-16055) sparkR.init() can not load sparkPackages when executing an R file

2016-06-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15338796#comment-15338796 ] Shivaram Venkataraman commented on SPARK-16055: --- I think passing in the `--packages` flag

[jira] [Resolved] (SPARK-6814) Support sorting for any data type in SparkR

2016-06-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6814. -- Resolution: Won't Fix Resolving this as we don't plan to expose the RDD API in

[jira] [Commented] (SPARK-9857) Add expression functions into SparkR which conflict with the existing R's generic

2016-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337526#comment-15337526 ] Shivaram Venkataraman commented on SPARK-9857: -- [~yuu.ishik...@gmail.com] [~sunrui] Do we

[jira] [Commented] (SPARK-15124) R 2.0 QA: New R APIs and API docs

2016-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337523#comment-15337523 ] Shivaram Venkataraman commented on SPARK-15124: --- One more item on this list is the

[jira] [Commented] (SPARK-6817) DataFrame UDFs in R

2016-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337525#comment-15337525 ] Shivaram Venkataraman commented on SPARK-6817: -- I think all the ones we need for 2.0 are

[jira] [Resolved] (SPARK-15159) SparkSession R API

2016-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15159. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-15159) SparkSession R API

2016-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-15159: -- Assignee: Felix Cheung > SparkSession R API > -- > >

[jira] [Resolved] (SPARK-16005) Add `randomSplit` to SparkR

2016-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16005. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s:

[jira] [Created] (SPARK-16029) Deprecate dropTempTable in SparkR

2016-06-17 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-16029: - Summary: Deprecate dropTempTable in SparkR Key: SPARK-16029 URL: https://issues.apache.org/jira/browse/SPARK-16029 Project: Spark Issue

[jira] [Commented] (SPARK-16029) Deprecate dropTempTable in SparkR

2016-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337159#comment-15337159 ] Shivaram Venkataraman commented on SPARK-16029: --- cc [~liancheng] [~felixcheung] >

[jira] [Created] (SPARK-16028) Remove the need to pass in a SparkContext for spark.lapply

2016-06-17 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-16028: - Summary: Remove the need to pass in a SparkContext for spark.lapply Key: SPARK-16028 URL: https://issues.apache.org/jira/browse/SPARK-16028

[jira] [Commented] (SPARK-16027) Fix SparkR session unit test

2016-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337151#comment-15337151 ] Shivaram Venkataraman commented on SPARK-16027: --- cc [~felixcheung] > Fix SparkR session

[jira] [Created] (SPARK-16027) Fix SparkR session unit test

2016-06-17 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-16027: - Summary: Fix SparkR session unit test Key: SPARK-16027 URL: https://issues.apache.org/jira/browse/SPARK-16027 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-15908) Add varargs-type dropDuplicates() function in SparkR

2016-06-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15908. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-15908) Add varargs-type dropDuplicates() function in SparkR

2016-06-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-15908: -- Assignee: Dongjoon Hyun > Add varargs-type dropDuplicates() function in SparkR

[jira] [Resolved] (SPARK-15996) Fix R examples by removing deprecated functions

2016-06-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15996. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-12922) Implement gapply() on DataFrame in SparkR

2016-06-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12922. --- Resolution: Fixed Assignee: Narine Kokhlikyan Fix Version/s:

[jira] [Resolved] (SPARK-15931) SparkR tests failing on R 3.3.0

2016-06-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15931. --- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.0.0

[jira] [Commented] (SPARK-15767) Decision Tree Regression wrapper in SparkR

2016-06-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329850#comment-15329850 ] Shivaram Venkataraman commented on SPARK-15767: --- Thanks [~vectorijk] - the high level

[jira] [Commented] (SPARK-15690) Fast single-node (single-process) in-memory shuffle

2016-06-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328717#comment-15328717 ] Shivaram Venkataraman commented on SPARK-15690: --- Yeah I dont think you'll see much

[jira] [Resolved] (SPARK-15925) Replaces registerTempTable with createOrReplaceTempView in SparkR

2016-06-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15925. --- Resolution: Fixed Issue resolved by pull request 13644

[jira] [Commented] (SPARK-15931) SparkR tests failing on R 3.3.0

2016-06-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328432#comment-15328432 ] Shivaram Venkataraman commented on SPARK-15931: --- cc [~felixcheung] We should print out what

[jira] [Commented] (SPARK-15924) SparkR parser bug with backslash in comments

2016-06-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15327851#comment-15327851 ] Shivaram Venkataraman commented on SPARK-15924: --- I'm not sure what part of this code

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-06-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326648#comment-15326648 ] Shivaram Venkataraman commented on SPARK-15799: --- [~sunrui] Your proposal sounds promising.

[jira] [Resolved] (SPARK-15766) R should export is.nan

2016-06-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15766. --- Resolution: Fixed Assignee: Miao Wang Fix Version/s: 2.0.0

[jira] [Commented] (SPARK-15672) R programming guide update

2016-06-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325145#comment-15325145 ] Shivaram Venkataraman commented on SPARK-15672: --- Yeah we can leave out gapply from the

[jira] [Commented] (SPARK-15855) dataframe.R example fails with "java.io.IOException: No input paths specified in job"

2016-06-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323667#comment-15323667 ] Shivaram Venkataraman commented on SPARK-15855: --- For the example to work in a distributed

[jira] [Resolved] (SPARK-15684) Not mask startsWith and endsWith in R

2016-06-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15684. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-15684) Not mask startsWith and endsWith in R

2016-06-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-15684: -- Assignee: Miao Wang > Not mask startsWith and endsWith in R >

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-06-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15318769#comment-15318769 ] Shivaram Venkataraman commented on SPARK-15799: --- I dont think there are any license issues

[jira] [Commented] (SPARK-13525) SparkR: java.net.SocketTimeoutException: Accept timed out when running any dataframe function

2016-06-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316908#comment-15316908 ] Shivaram Venkataraman commented on SPARK-13525: --- [~vmenda] Your stack trace indicates that

[jira] [Commented] (SPARK-15159) SparkSession R API

2016-06-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316898#comment-15316898 ] Shivaram Venkataraman commented on SPARK-15159: --- That sounds good. Also one way to handle

[jira] [Commented] (SPARK-13174) Add API and options for csv data sources

2016-06-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316848#comment-15316848 ] Shivaram Venkataraman commented on SPARK-13174: --- +1 for `read.df("path/to/file.csv", source

[jira] [Commented] (SPARK-12923) Optimize successive dapply() calls in SparkR

2016-06-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316062#comment-15316062 ] Shivaram Venkataraman commented on SPARK-12923: --- [~sunrui] Can we move this from the UDFs

[jira] [Commented] (SPARK-15521) Add high level APIs based on dapply and gapply for easier usage

2016-06-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316060#comment-15316060 ] Shivaram Venkataraman commented on SPARK-15521: --- [~sunrui] Can we move this from the UDFs

[jira] [Commented] (SPARK-15159) SparkSession R API

2016-06-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316031#comment-15316031 ] Shivaram Venkataraman commented on SPARK-15159: --- [~felixcheung] Are you working on this ?

[jira] [Commented] (SPARK-15545) R remove non-exported unused methods, like jsonRDD

2016-06-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315991#comment-15315991 ] Shivaram Venkataraman commented on SPARK-15545: --- That discussion was before we had UDFs

[jira] [Commented] (SPARK-15684) Not mask startsWith and endsWith in R

2016-06-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310566#comment-15310566 ] Shivaram Venkataraman commented on SPARK-15684: --- We just need to match the signature to the

[jira] [Commented] (SPARK-15672) R programming guide update

2016-05-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15309249#comment-15309249 ] Shivaram Venkataraman commented on SPARK-15672: --- Thanks [~GayathriMurali] - This PR can

[jira] [Commented] (SPARK-15672) R programming guide update

2016-05-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15307984#comment-15307984 ] Shivaram Venkataraman commented on SPARK-15672: --- cc [~felixcheung] [~sunrui] > R

[jira] [Created] (SPARK-15672) R programming guide update

2016-05-31 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-15672: - Summary: R programming guide update Key: SPARK-15672 URL: https://issues.apache.org/jira/browse/SPARK-15672 Project: Spark Issue Type:

[jira] [Commented] (SPARK-12169) SparkR 2.0

2016-05-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305665#comment-15305665 ] Shivaram Venkataraman commented on SPARK-12169: --- I think the SparkSession R API is the only

[jira] [Updated] (SPARK-15637) SparkR tests failing on R 3.2.2

2016-05-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-15637: -- Assignee: Felix Cheung > SparkR tests failing on R 3.2.2 >

[jira] [Resolved] (SPARK-15637) SparkR tests failing on R 3.2.2

2016-05-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15637. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

<    1   2   3   4   5   6   7   8   9   10   >