[jira] [Resolved] (SPARK-12337) Implement dropDuplicates() method of DataFrame in SparkR

2016-01-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12337. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-12232) Create new R API for read.table to avoid conflict

2016-01-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12232: -- Assignee: Felix Cheung > Create new R API for read.table to avoid conflict >

[jira] [Resolved] (SPARK-12232) Create new R API for read.table to avoid conflict

2016-01-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12232. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-12862) Jenkins does not run R tests

2016-01-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12862. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-12862) Jenkins does not run R tests

2016-01-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12862: -- Assignee: Felix Cheung > Jenkins does not run R tests >

[jira] [Commented] (SPARK-11031) SparkR str() method on DataFrame objects

2016-01-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15101936#comment-15101936 ] Shivaram Venkataraman commented on SPARK-11031: --- Resolved by

[jira] [Resolved] (SPARK-11031) SparkR str() method on DataFrame objects

2016-01-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11031. --- Resolution: Fixed Fix Version/s: 2.0.0 1.6.1 >

[jira] [Updated] (SPARK-11031) SparkR str() method on DataFrame objects

2016-01-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11031: -- Assignee: Oscar D. Lara Yejas > SparkR str() method on DataFrame objects >

[jira] [Commented] (SPARK-12635) More efficient (column batch) serialization for Python/R

2016-01-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090461#comment-15090461 ] Shivaram Venkataraman commented on SPARK-12635: --- cc [~sunrui] who is working on the SparkR

[jira] [Commented] (SPARK-12609) Make R to JVM timeout configurable

2016-01-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090464#comment-15090464 ] Shivaram Venkataraman commented on SPARK-12609: --- There are other ways to check if the JVM

[jira] [Resolved] (SPARK-12645) SparkR support hash function

2016-01-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12645. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Updated] (SPARK-12645) SparkR support hash function

2016-01-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12645: -- Assignee: Yanbo Liang > SparkR support hash function >

[jira] [Resolved] (SPARK-12393) Add read.text and write.text for SparkR

2016-01-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12393. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Updated] (SPARK-12393) Add read.text and write.text for SparkR

2016-01-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12393: -- Assignee: Yanbo Liang > Add read.text and write.text for SparkR >

[jira] [Commented] (SPARK-12609) Make R to JVM timeout configurable

2016-01-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082309#comment-15082309 ] Shivaram Venkataraman commented on SPARK-12609: --- Yeah that would be good but I think it

[jira] [Commented] (SPARK-12609) Make R to JVM timeout configurable

2016-01-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080659#comment-15080659 ] Shivaram Venkataraman commented on SPARK-12609: --- It was from a user running long jobs and

[jira] [Updated] (SPARK-12609) Make R to JVM timeout configurable

2016-01-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12609: -- Component/s: (was: rkR) > Make R to JVM timeout configurable >

[jira] [Resolved] (SPARK-12327) lint-r checks fail with commented code

2016-01-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12327. --- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.0.0

[jira] [Created] (SPARK-12609) Make R to JVM timeout configurable

2016-01-03 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-12609: - Summary: Make R to JVM timeout configurable Key: SPARK-12609 URL: https://issues.apache.org/jira/browse/SPARK-12609 Project: Spark Issue

[jira] [Resolved] (SPARK-12526) `ifelse`, `when`, `otherwise` unable to take Column as value

2015-12-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12526. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Updated] (SPARK-12526) `ifelse`, `when`, `otherwise` unable to take Column as value

2015-12-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12526: -- Assignee: Sen Fang > `ifelse`, `when`, `otherwise` unable to take Column as

[jira] [Commented] (SPARK-12360) Support using 64-bit long type in SparkR

2015-12-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15065263#comment-15065263 ] Shivaram Venkataraman commented on SPARK-12360: --- Yeah we can return a integer error code

[jira] [Commented] (SPARK-12360) Support using 64-bit long type in SparkR

2015-12-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063352#comment-15063352 ] Shivaram Venkataraman commented on SPARK-12360: --- For all the random seed cases we should

[jira] [Commented] (SPARK-10500) sparkr.zip cannot be created if $SPARK_HOME/R/lib is unwritable

2015-12-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063295#comment-15063295 ] Shivaram Venkataraman commented on SPARK-10500: --- I don't mind merging this in to branch-1.5

[jira] [Updated] (SPARK-12318) Save mode in SparkR should be error by default

2015-12-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12318: -- Assignee: Jeff Zhang > Save mode in SparkR should be error by default >

[jira] [Commented] (SPARK-12360) Support using 64-bit long type in SparkR

2015-12-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060381#comment-15060381 ] Shivaram Venkataraman commented on SPARK-12360: --- The lack of 64 bit numbers is a limitation

[jira] [Resolved] (SPARK-12318) Save mode in SparkR should be error by default

2015-12-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12318. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-12310) Add write.json and write.parquet for SparkR

2015-12-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12310. --- Resolution: Fixed Assignee: Yanbo Liang (was: Apache Spark)

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058464#comment-15058464 ] Shivaram Venkataraman commented on SPARK-12327: --- Do you have a link to the PR ? These are

[jira] [Commented] (SPARK-10347) Investigate the usage of normalizePath()

2015-12-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058520#comment-15058520 ] Shivaram Venkataraman commented on SPARK-10347: --- I think its a good idea to fix and also a

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

2015-12-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058456#comment-15058456 ] Shivaram Venkataraman commented on SPARK-11255: --- Yeah we could bump up the R version as a

[jira] [Commented] (SPARK-10312) Enhance SerDe to handle atomic vector

2015-12-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058478#comment-15058478 ] Shivaram Venkataraman commented on SPARK-10312: --- SInce the SerDe is an internal API I think

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056969#comment-15056969 ] Shivaram Venkataraman commented on SPARK-12327: --- cc [~felixcheung] This is related to

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057033#comment-15057033 ] Shivaram Venkataraman commented on SPARK-12327: --- Yeah [~felixcheung] I think we could tag

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057030#comment-15057030 ] Shivaram Venkataraman commented on SPARK-12327: --- This test is currently disabled by

[jira] [Assigned] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-12327: - Assignee: (was: Apache Spark) > lint-r checks fail with commented

[jira] [Created] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-12327: - Summary: lint-r checks fail with commented code Key: SPARK-12327 URL: https://issues.apache.org/jira/browse/SPARK-12327 Project: Spark

[jira] [Updated] (SPARK-12158) [R] [SQL] Fix 'sample' functions that break R unit test cases

2015-12-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12158: -- Assignee: Xiao Li > [R] [SQL] Fix 'sample' functions that break R unit test

[jira] [Resolved] (SPARK-12158) [R] [SQL] Fix 'sample' functions that break R unit test cases

2015-12-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12158. --- Resolution: Fixed Fix Version/s: 2.0.0 1.6.1

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

2015-12-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053921#comment-15053921 ] Shivaram Venkataraman commented on SPARK-6270: -- Yeah I think thats a fair solution to this

[jira] [Resolved] (SPARK-12146) SparkR jsonFile should support multiple input files

2015-12-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12146. --- Resolution: Fixed Assignee: Yanbo Liang Fix Version/s: 2.0.0

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

2015-12-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053400#comment-15053400 ] Shivaram Venkataraman commented on SPARK-6270: -- +1 on compression. Is there a flag to turn it

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

2015-12-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053223#comment-15053223 ] Shivaram Venkataraman commented on SPARK-6270: -- I looked into our log file more closely and

[jira] [Resolved] (SPARK-12198) SparkR support read.parquet and deprecate parquetFile

2015-12-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12198. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-12172) Consider removing SparkR internal RDD APIs

2015-12-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051320#comment-15051320 ] Shivaram Venkataraman commented on SPARK-12172: --- My opinion is that we should introduce the

[jira] [Commented] (SPARK-12232) Consider exporting read.table in R

2015-12-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051351#comment-15051351 ] Shivaram Venkataraman commented on SPARK-12232: --- Yeah I'm not sure we should expose

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

2015-12-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051438#comment-15051438 ] Shivaram Venkataraman commented on SPARK-6270: -- FWIW this problem happens 1.5.2 as well --

[jira] [Updated] (SPARK-12198) SparkR support read.parquet and deprecate parquetFile

2015-12-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12198: -- Assignee: Yanbo Liang > SparkR support read.parquet and deprecate parquetFile

[jira] [Resolved] (SPARK-12234) SparkR subset throw error when only set "select" argument

2015-12-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12234. --- Resolution: Fixed Assignee: Yanbo Liang Fix Version/s: 1.6.0

[jira] [Resolved] (SPARK-12239) ​SparkR - Not distributing SparkR module in YARN

2015-12-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12239. --- Resolution: Not A Problem > ​SparkR - Not distributing SparkR module in YARN

[jira] [Commented] (SPARK-12239) ​SparkR - Not distributing SparkR module in YARN

2015-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049752#comment-15049752 ] Shivaram Venkataraman commented on SPARK-12239: --- Thanks for the report. I'm not sure this

[jira] [Updated] (SPARK-12034) Eliminate warnings in SparkR test cases

2015-12-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12034: -- Assignee: Sun Rui > Eliminate warnings in SparkR test cases >

[jira] [Resolved] (SPARK-12034) Eliminate warnings in SparkR test cases

2015-12-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12034. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-12169) SparkR 2.0

2015-12-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044418#comment-15044418 ] Shivaram Venkataraman commented on SPARK-12169: --- Thanks [~sunrui] for starting this. You

[jira] [Resolved] (SPARK-12044) Fix usage of isnan, isNaN

2015-12-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12044. --- Resolution: Fixed Assignee: Yanbo Liang Fix Version/s: 2.0.0

[jira] [Resolved] (SPARK-9972) Add `struct`, `encode` and `decode` function in SparkR

2015-12-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9972. -- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 2.0.0

[jira] [Resolved] (SPARK-11715) R support corr for Column Aggregration

2015-12-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11715. --- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.0.0

[jira] [Resolved] (SPARK-11774) Implement "struct", "encode","decode" in SparkR

2015-12-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11774. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 2.0.0

[jira] [Resolved] (SPARK-12115) Change numPartitions() in RDD to be "getNumPartitions" to be consistent with pyspark/scala

2015-12-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12115. --- Resolution: Fixed Assignee: Yanbo Liang Fix Version/s: 2.0.0

[jira] [Commented] (SPARK-12144) Implement DataFrameReader and DataFrameWriter API in SparkR

2015-12-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15040773#comment-15040773 ] Shivaram Venkataraman commented on SPARK-12144: --- Personally I don't think this API is a

[jira] [Resolved] (SPARK-12104) collect() does not handle multiple columns with same name

2015-12-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12104. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Updated] (SPARK-12104) collect() does not handle multiple columns with same name

2015-12-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12104: -- Assignee: Sun Rui > collect() does not handle multiple columns with same name

[jira] [Resolved] (SPARK-12116) Document workaround when method conflicts with another R package, like dplyr

2015-12-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12116. --- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 1.6.0

[jira] [Updated] (SPARK-12107) Update spark-ec2 versions

2015-12-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12107: -- Assignee: Nicholas Chammas > Update spark-ec2 versions >

[jira] [Resolved] (SPARK-12107) Update spark-ec2 versions

2015-12-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12107. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Commented] (SPARK-12107) Update spark-ec2 versions

2015-12-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038498#comment-15038498 ] Shivaram Venkataraman commented on SPARK-12107: --- cc [~marmbrus] Fix version needs to be

[jira] [Updated] (SPARK-12019) SparkR.init does not support character vector for sparkJars and sparkPackages

2015-12-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12019: -- Assignee: Felix Cheung > SparkR.init does not support character vector for

[jira] [Resolved] (SPARK-12019) SparkR.init does not support character vector for sparkJars and sparkPackages

2015-12-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12019. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Commented] (SPARK-12104) collect() does not handle multiple columns with same name

2015-12-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036791#comment-15036791 ] Shivaram Venkataraman commented on SPARK-12104: --- Any ideas what caused this ? > collect()

[jira] [Commented] (SPARK-11886) R function name conflicts with base or stats package ones

2015-12-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035381#comment-15035381 ] Shivaram Venkataraman commented on SPARK-11886: --- Thanks for testing this. I am not sure why

[jira] [Commented] (SPARK-6830) Memoize frequently queried vals in RDD, such as numPartitions, count etc.

2015-12-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1505#comment-1505 ] Shivaram Venkataraman commented on SPARK-6830: -- I think the right place to do this is not in

[jira] [Commented] (SPARK-11886) R function name conflicts with base or stats package ones

2015-11-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032820#comment-15032820 ] Shivaram Venkataraman commented on SPARK-11886: --- We can't really help this scenario --

[jira] [Resolved] (SPARK-11781) SparkR has problem in inferring type of raw type

2015-11-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11781. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-11781) SparkR has problem in inferring type of raw type

2015-11-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11781: -- Assignee: Sun Rui > SparkR has problem in inferring type of raw type >

[jira] [Commented] (SPARK-11886) R function name conflicts with base or stats package ones

2015-11-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030666#comment-15030666 ] Shivaram Venkataraman commented on SPARK-11886: --- Not really - Given the nature of the dplyr

[jira] [Updated] (SPARK-12029) Improve column functions signature, param check, tests, fix doc and add examples

2015-11-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12029: -- Assignee: Felix Cheung > Improve column functions signature, param check,

[jira] [Resolved] (SPARK-9319) Add support for setting column names, types

2015-11-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9319. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-9319) Add support for setting column names, types

2015-11-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9319: - Assignee: Felix Cheung > Add support for setting column names, types >

[jira] [Resolved] (SPARK-12029) Improve column functions signature, param check, tests, fix doc and add examples

2015-11-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12029. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-12025) Rename some window rank function names for SparkR

2015-11-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12025: -- Assignee: Yanbo Liang > Rename some window rank function names for SparkR >

[jira] [Resolved] (SPARK-12025) Rename some window rank function names for SparkR

2015-11-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12025. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-11756) SparkR can not output help information for SparkR:::summary correctly

2015-11-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11756: -- Assignee: Felix Cheung > SparkR can not output help information for

[jira] [Resolved] (SPARK-11756) SparkR can not output help information for SparkR:::summary correctly

2015-11-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11756. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-11773) Implement collection functions in SparkR

2015-11-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11773: -- Assignee: Sun Rui > Implement collection functions in SparkR >

[jira] [Resolved] (SPARK-11773) Implement collection functions in SparkR

2015-11-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11773. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-11281) Issue with creating and collecting DataFrame using environments

2015-11-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11281. --- Resolution: Fixed Assignee: Maciej Szymkiewicz Resolved by

[jira] [Resolved] (SPARK-11339) Fix and document the list of functions in R base package that are masked by functions with same name in SparkR

2015-11-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11339. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-11339) Fix and document the list of functions in R base package that are masked by functions with same name in SparkR

2015-11-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11339: -- Assignee: Felix Cheung > Fix and document the list of functions in R base

[jira] [Resolved] (SPARK-11755) SparkR can not output help information for SparkR:::predict

2015-11-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11755. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-11755) SparkR can not output help information for SparkR:::predict

2015-11-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11755: -- Assignee: Yanbo Liang > SparkR can not output help information for

[jira] [Commented] (SPARK-11281) Issue with creating and collecting DataFrame using environments

2015-11-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006966#comment-15006966 ] Shivaram Venkataraman commented on SPARK-11281: --- Does the example posted in the description

[jira] [Commented] (SPARK-11281) Issue with creating and collecting DataFrame using environments

2015-11-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006955#comment-15006955 ] Shivaram Venkataraman commented on SPARK-11281: --- [~sunrui] [~zero323] Is there a test case

[jira] [Reopened] (SPARK-11281) Issue with creating and collecting DataFrame using environments

2015-11-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reopened SPARK-11281: --- Assignee: (was: Maciej Szymkiewicz) > Issue with creating and

[jira] [Commented] (SPARK-11281) Issue with creating and collecting DataFrame using environments

2015-11-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007064#comment-15007064 ] Shivaram Venkataraman commented on SPARK-11281: --- Thats cool ! lets keep this open till we

[jira] [Reopened] (SPARK-9603) Re-enable complex R package test in SparkSubmitSuite

2015-11-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reopened SPARK-9603: -- We still have some failures on Jenkins as reported in

[jira] [Resolved] (SPARK-8277) SparkR createDataFrame is slow

2015-11-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8277. -- Resolution: Fixed Assignee: Maciej Szymkiewicz Fix Version/s:

[jira] [Resolved] (SPARK-11086) createDataFrame should dropFactor column-wise not cell-wise

2015-11-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11086. --- Resolution: Fixed Assignee: Maciej Szymkiewicz Fix Version/s:

[jira] [Resolved] (SPARK-10500) sparkr.zip cannot be created if $SPARK_HOME/R/lib is unwritable

2015-11-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10500. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-10500) sparkr.zip cannot be created if $SPARK_HOME/R/lib is unwritable

2015-11-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10500: -- Assignee: Sun Rui > sparkr.zip cannot be created if $SPARK_HOME/R/lib is

[jira] [Updated] (SPARK-11263) lintr Throws Warnings on Commented Code in Documentation

2015-11-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11263: -- Assignee: Felix Cheung > lintr Throws Warnings on Commented Code in

<    1   2   3   4   5   6   7   8   9   10   >