[jira] [Resolved] (SPARK-12107) Update spark-ec2 versions

[ https://issues.apache.org/jira/browse/SPARK-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12107. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Commented] (SPARK-12107) Update spark-ec2 versions

[ https://issues.apache.org/jira/browse/SPARK-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038498#comment-15038498 ] Shivaram Venkataraman commented on SPARK-12107: --- cc [~marmbrus] Fix version needs to be

[jira] [Updated] (SPARK-12019) SparkR.init does not support character vector for sparkJars and sparkPackages

[ https://issues.apache.org/jira/browse/SPARK-12019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12019: -- Assignee: Felix Cheung > SparkR.init does not support character vector for

[jira] [Resolved] (SPARK-12019) SparkR.init does not support character vector for sparkJars and sparkPackages

[ https://issues.apache.org/jira/browse/SPARK-12019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12019. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Commented] (SPARK-11886) R function name conflicts with base or stats package ones

[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035381#comment-15035381 ] Shivaram Venkataraman commented on SPARK-11886: --- Thanks for testing this. I am not sure why

[jira] [Updated] (SPARK-12034) Eliminate warnings in SparkR test cases

[ https://issues.apache.org/jira/browse/SPARK-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12034: -- Assignee: Sun Rui > Eliminate warnings in SparkR test cases >

[jira] [Resolved] (SPARK-12034) Eliminate warnings in SparkR test cases

[ https://issues.apache.org/jira/browse/SPARK-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12034. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-12239) ​SparkR - Not distributing SparkR module in YARN

[ https://issues.apache.org/jira/browse/SPARK-12239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049752#comment-15049752 ] Shivaram Venkataraman commented on SPARK-12239: --- Thanks for the report. I'm not sure this

[jira] [Resolved] (SPARK-12198) SparkR support read.parquet and deprecate parquetFile

[ https://issues.apache.org/jira/browse/SPARK-12198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12198. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-12172) Consider removing SparkR internal RDD APIs

[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051320#comment-15051320 ] Shivaram Venkataraman commented on SPARK-12172: --- My opinion is that we should introduce the

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058464#comment-15058464 ] Shivaram Venkataraman commented on SPARK-12327: --- Do you have a link to the PR ? These are

[jira] [Commented] (SPARK-10347) Investigate the usage of normalizePath()

[ https://issues.apache.org/jira/browse/SPARK-10347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058520#comment-15058520 ] Shivaram Venkataraman commented on SPARK-10347: --- I think its a good idea to fix and also a

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058456#comment-15058456 ] Shivaram Venkataraman commented on SPARK-11255: --- Yeah we could bump up the R version as a

[jira] [Commented] (SPARK-10312) Enhance SerDe to handle atomic vector

[ https://issues.apache.org/jira/browse/SPARK-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058478#comment-15058478 ] Shivaram Venkataraman commented on SPARK-10312: --- SInce the SerDe is an internal API I think

[jira] [Updated] (SPARK-12318) Save mode in SparkR should be error by default

[ https://issues.apache.org/jira/browse/SPARK-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12318: -- Assignee: Jeff Zhang > Save mode in SparkR should be error by default >

[jira] [Commented] (SPARK-12360) Support using 64-bit long type in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060381#comment-15060381 ] Shivaram Venkataraman commented on SPARK-12360: --- The lack of 64 bit numbers is a limitation

[jira] [Resolved] (SPARK-12318) Save mode in SparkR should be error by default

[ https://issues.apache.org/jira/browse/SPARK-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12318. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-12310) Add write.json and write.parquet for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12310. --- Resolution: Fixed Assignee: Yanbo Liang (was: Apache Spark)

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056969#comment-15056969 ] Shivaram Venkataraman commented on SPARK-12327: --- cc [~felixcheung] This is related to

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057033#comment-15057033 ] Shivaram Venkataraman commented on SPARK-12327: --- Yeah [~felixcheung] I think we could tag

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057030#comment-15057030 ] Shivaram Venkataraman commented on SPARK-12327: --- This test is currently disabled by

[jira] [Assigned] (SPARK-12327) lint-r checks fail with commented code

[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-12327: - Assignee: (was: Apache Spark) > lint-r checks fail with commented

[jira] [Updated] (SPARK-12158) [R] [SQL] Fix 'sample' functions that break R unit test cases

[ https://issues.apache.org/jira/browse/SPARK-12158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12158: -- Assignee: Xiao Li > [R] [SQL] Fix 'sample' functions that break R unit test

[jira] [Resolved] (SPARK-12158) [R] [SQL] Fix 'sample' functions that break R unit test cases

[ https://issues.apache.org/jira/browse/SPARK-12158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12158. --- Resolution: Fixed Fix Version/s: 2.0.0 1.6.1

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053921#comment-15053921 ] Shivaram Venkataraman commented on SPARK-6270: -- Yeah I think thats a fair solution to this

[jira] [Resolved] (SPARK-12146) SparkR jsonFile should support multiple input files

[ https://issues.apache.org/jira/browse/SPARK-12146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12146. --- Resolution: Fixed Assignee: Yanbo Liang Fix Version/s: 2.0.0

[jira] [Commented] (SPARK-12232) Consider exporting read.table in R

[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051351#comment-15051351 ] Shivaram Venkataraman commented on SPARK-12232: --- Yeah I'm not sure we should expose

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051438#comment-15051438 ] Shivaram Venkataraman commented on SPARK-6270: -- FWIW this problem happens 1.5.2 as well --

[jira] [Updated] (SPARK-12198) SparkR support read.parquet and deprecate parquetFile

[ https://issues.apache.org/jira/browse/SPARK-12198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12198: -- Assignee: Yanbo Liang > SparkR support read.parquet and deprecate parquetFile

[jira] [Resolved] (SPARK-12234) SparkR subset throw error when only set "select" argument

[ https://issues.apache.org/jira/browse/SPARK-12234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12234. --- Resolution: Fixed Assignee: Yanbo Liang Fix Version/s: 1.6.0

[jira] [Resolved] (SPARK-12239) ​SparkR - Not distributing SparkR module in YARN

[ https://issues.apache.org/jira/browse/SPARK-12239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12239. --- Resolution: Not A Problem > ​SparkR - Not distributing SparkR module in YARN

[jira] [Created] (SPARK-12327) lint-r checks fail with commented code

Shivaram Venkataraman created SPARK-12327: - Summary: lint-r checks fail with commented code Key: SPARK-12327 URL: https://issues.apache.org/jira/browse/SPARK-12327 Project: Spark

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053400#comment-15053400 ] Shivaram Venkataraman commented on SPARK-6270: -- +1 on compression. Is there a flag to turn it

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15053223#comment-15053223 ] Shivaram Venkataraman commented on SPARK-6270: -- I looked into our log file more closely and

[jira] [Commented] (SPARK-12609) Make R to JVM timeout configurable

[ https://issues.apache.org/jira/browse/SPARK-12609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080659#comment-15080659 ] Shivaram Venkataraman commented on SPARK-12609: --- It was from a user running long jobs and

[jira] [Commented] (SPARK-12609) Make R to JVM timeout configurable

[ https://issues.apache.org/jira/browse/SPARK-12609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082309#comment-15082309 ] Shivaram Venkataraman commented on SPARK-12609: --- Yeah that would be good but I think it

[jira] [Updated] (SPARK-12609) Make R to JVM timeout configurable

[ https://issues.apache.org/jira/browse/SPARK-12609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12609: -- Component/s: (was: rkR) > Make R to JVM timeout configurable >

[jira] [Resolved] (SPARK-12327) lint-r checks fail with commented code

[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12327. --- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.0.0

[jira] [Created] (SPARK-12609) Make R to JVM timeout configurable

Shivaram Venkataraman created SPARK-12609: - Summary: Make R to JVM timeout configurable Key: SPARK-12609 URL: https://issues.apache.org/jira/browse/SPARK-12609 Project: Spark Issue

[jira] [Resolved] (SPARK-12393) Add read.text and write.text for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12393. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Updated] (SPARK-12393) Add read.text and write.text for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12393: -- Assignee: Yanbo Liang > Add read.text and write.text for SparkR >

[jira] [Commented] (SPARK-12635) More efficient (column batch) serialization for Python/R

[ https://issues.apache.org/jira/browse/SPARK-12635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090461#comment-15090461 ] Shivaram Venkataraman commented on SPARK-12635: --- cc [~sunrui] who is working on the SparkR

[jira] [Commented] (SPARK-12609) Make R to JVM timeout configurable

[ https://issues.apache.org/jira/browse/SPARK-12609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090464#comment-15090464 ] Shivaram Venkataraman commented on SPARK-12609: --- There are other ways to check if the JVM

[jira] [Resolved] (SPARK-12645) SparkR support hash function

[ https://issues.apache.org/jira/browse/SPARK-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12645. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Updated] (SPARK-12645) SparkR support hash function

[ https://issues.apache.org/jira/browse/SPARK-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12645: -- Assignee: Yanbo Liang > SparkR support hash function >

[jira] [Commented] (SPARK-12360) Support using 64-bit long type in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15065263#comment-15065263 ] Shivaram Venkataraman commented on SPARK-12360: --- Yeah we can return a integer error code

[jira] [Resolved] (SPARK-12526) `ifelse`, `when`, `otherwise` unable to take Column as value

[ https://issues.apache.org/jira/browse/SPARK-12526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12526. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Updated] (SPARK-12526) `ifelse`, `when`, `otherwise` unable to take Column as value

[ https://issues.apache.org/jira/browse/SPARK-12526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12526: -- Assignee: Sen Fang > `ifelse`, `when`, `otherwise` unable to take Column as

[jira] [Commented] (SPARK-12360) Support using 64-bit long type in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063352#comment-15063352 ] Shivaram Venkataraman commented on SPARK-12360: --- For all the random seed cases we should

[jira] [Commented] (SPARK-10500) sparkr.zip cannot be created if $SPARK_HOME/R/lib is unwritable

[ https://issues.apache.org/jira/browse/SPARK-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063295#comment-15063295 ] Shivaram Venkataraman commented on SPARK-10500: --- I don't mind merging this in to branch-1.5

[jira] [Commented] (SPARK-11886) R function name conflicts with base or stats package ones

[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030666#comment-15030666 ] Shivaram Venkataraman commented on SPARK-11886: --- Not really - Given the nature of the dplyr

[jira] [Updated] (SPARK-12029) Improve column functions signature, param check, tests, fix doc and add examples

[ https://issues.apache.org/jira/browse/SPARK-12029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12029: -- Assignee: Felix Cheung > Improve column functions signature, param check,

[jira] [Resolved] (SPARK-9319) Add support for setting column names, types

[ https://issues.apache.org/jira/browse/SPARK-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9319. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-9319) Add support for setting column names, types

[ https://issues.apache.org/jira/browse/SPARK-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9319: - Assignee: Felix Cheung > Add support for setting column names, types >

[jira] [Resolved] (SPARK-12029) Improve column functions signature, param check, tests, fix doc and add examples

[ https://issues.apache.org/jira/browse/SPARK-12029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12029. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-11886) R function name conflicts with base or stats package ones

[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032820#comment-15032820 ] Shivaram Venkataraman commented on SPARK-11886: --- We can't really help this scenario --

[jira] [Commented] (SPARK-6830) Memoize frequently queried vals in RDD, such as numPartitions, count etc.

[ https://issues.apache.org/jira/browse/SPARK-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1505#comment-1505 ] Shivaram Venkataraman commented on SPARK-6830: -- I think the right place to do this is not in

[jira] [Resolved] (SPARK-11339) Fix and document the list of functions in R base package that are masked by functions with same name in SparkR

[ https://issues.apache.org/jira/browse/SPARK-11339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11339. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-11339) Fix and document the list of functions in R base package that are masked by functions with same name in SparkR

[ https://issues.apache.org/jira/browse/SPARK-11339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11339: -- Assignee: Felix Cheung > Fix and document the list of functions in R base

[jira] [Updated] (SPARK-11756) SparkR can not output help information for SparkR:::summary correctly

[ https://issues.apache.org/jira/browse/SPARK-11756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11756: -- Assignee: Felix Cheung > SparkR can not output help information for

[jira] [Resolved] (SPARK-11756) SparkR can not output help information for SparkR:::summary correctly

[ https://issues.apache.org/jira/browse/SPARK-11756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11756. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-11755) SparkR can not output help information for SparkR:::predict

[ https://issues.apache.org/jira/browse/SPARK-11755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11755. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-11755) SparkR can not output help information for SparkR:::predict

[ https://issues.apache.org/jira/browse/SPARK-11755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11755: -- Assignee: Yanbo Liang > SparkR can not output help information for

[jira] [Commented] (SPARK-15545) R remove non-exported unused methods, like jsonRDD

[ https://issues.apache.org/jira/browse/SPARK-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315991#comment-15315991 ] Shivaram Venkataraman commented on SPARK-15545: --- That discussion was before we had UDFs

[jira] [Resolved] (SPARK-15684) Not mask startsWith and endsWith in R

[ https://issues.apache.org/jira/browse/SPARK-15684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15684. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15318769#comment-15318769 ] Shivaram Venkataraman commented on SPARK-15799: --- I dont think there are any license issues

[jira] [Updated] (SPARK-15684) Not mask startsWith and endsWith in R

[ https://issues.apache.org/jira/browse/SPARK-15684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-15684: -- Assignee: Miao Wang > Not mask startsWith and endsWith in R >

[jira] [Commented] (SPARK-15159) SparkSession R API

[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316898#comment-15316898 ] Shivaram Venkataraman commented on SPARK-15159: --- That sounds good. Also one way to handle

[jira] [Commented] (SPARK-13525) SparkR: java.net.SocketTimeoutException: Accept timed out when running any dataframe function

[ https://issues.apache.org/jira/browse/SPARK-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316908#comment-15316908 ] Shivaram Venkataraman commented on SPARK-13525: --- [~vmenda] Your stack trace indicates that

[jira] [Commented] (SPARK-13174) Add API and options for csv data sources

[ https://issues.apache.org/jira/browse/SPARK-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316848#comment-15316848 ] Shivaram Venkataraman commented on SPARK-13174: --- +1 for `read.df("path/to/file.csv", source

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326648#comment-15326648 ] Shivaram Venkataraman commented on SPARK-15799: --- [~sunrui] Your proposal sounds promising.

[jira] [Commented] (SPARK-15672) R programming guide update

[ https://issues.apache.org/jira/browse/SPARK-15672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325145#comment-15325145 ] Shivaram Venkataraman commented on SPARK-15672: --- Yeah we can leave out gapply from the

[jira] [Resolved] (SPARK-15766) R should export is.nan

[ https://issues.apache.org/jira/browse/SPARK-15766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15766. --- Resolution: Fixed Assignee: Miao Wang Fix Version/s: 2.0.0

[jira] [Commented] (SPARK-15855) dataframe.R example fails with "java.io.IOException: No input paths specified in job"

[ https://issues.apache.org/jira/browse/SPARK-15855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323667#comment-15323667 ] Shivaram Venkataraman commented on SPARK-15855: --- For the example to work in a distributed

[jira] [Resolved] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12071. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-15412) Improve linear & isotonic regression methods PyDocs

[ https://issues.apache.org/jira/browse/SPARK-15412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15412. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Commented] (SPARK-15924) SparkR parser bug with backslash in comments

[ https://issues.apache.org/jira/browse/SPARK-15924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15327851#comment-15327851 ] Shivaram Venkataraman commented on SPARK-15924: --- I'm not sure what part of this code

[jira] [Commented] (SPARK-15767) Decision Tree Regression wrapper in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329850#comment-15329850 ] Shivaram Venkataraman commented on SPARK-15767: --- Thanks [~vectorijk] - the high level

[jira] [Resolved] (SPARK-15931) SparkR tests failing on R 3.3.0

[ https://issues.apache.org/jira/browse/SPARK-15931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15931. --- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.0.0

[jira] [Commented] (SPARK-15931) SparkR tests failing on R 3.3.0

[ https://issues.apache.org/jira/browse/SPARK-15931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328432#comment-15328432 ] Shivaram Venkataraman commented on SPARK-15931: --- cc [~felixcheung] We should print out what

[jira] [Resolved] (SPARK-15925) Replaces registerTempTable with createOrReplaceTempView in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15925. --- Resolution: Fixed Issue resolved by pull request 13644

[jira] [Commented] (SPARK-15159) SparkSession R API

[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316031#comment-15316031 ] Shivaram Venkataraman commented on SPARK-15159: --- [~felixcheung] Are you working on this ?

[jira] [Commented] (SPARK-12923) Optimize successive dapply() calls in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316062#comment-15316062 ] Shivaram Venkataraman commented on SPARK-12923: --- [~sunrui] Can we move this from the UDFs

[jira] [Commented] (SPARK-15521) Add high level APIs based on dapply and gapply for easier usage

[ https://issues.apache.org/jira/browse/SPARK-15521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316060#comment-15316060 ] Shivaram Venkataraman commented on SPARK-15521: --- [~sunrui] Can we move this from the UDFs

[jira] [Commented] (SPARK-12169) SparkR 2.0

[ https://issues.apache.org/jira/browse/SPARK-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305665#comment-15305665 ] Shivaram Venkataraman commented on SPARK-12169: --- I think the SparkSession R API is the only

[jira] [Resolved] (SPARK-15637) SparkR tests failing on R 3.2.2

[ https://issues.apache.org/jira/browse/SPARK-15637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15637. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-15637) SparkR tests failing on R 3.2.2

[ https://issues.apache.org/jira/browse/SPARK-15637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-15637: -- Assignee: Felix Cheung > SparkR tests failing on R 3.2.2 >

[jira] [Resolved] (SPARK-15439) Failed to run unit test in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15439. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-15439) Failed to run unit test in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-15439: -- Assignee: Miao Wang > Failed to run unit test in SparkR >

[jira] [Commented] (SPARK-15439) Failed to run unit test in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302525#comment-15302525 ] Shivaram Venkataraman commented on SPARK-15439: --- Hmm - I think the check needs to be

[jira] [Resolved] (SPARK-10903) Simplify SQLContext method signatures and use a singleton

[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10903. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-10903) Simplify SQLContext method signatures and use a singleton

[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10903: -- Assignee: Felix Cheung > Simplify SQLContext method signatures and use a

[jira] [Commented] (SPARK-15585) Don't use null in data source options to indicate default value

[ https://issues.apache.org/jira/browse/SPARK-15585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304267#comment-15304267 ] Shivaram Venkataraman commented on SPARK-15585: --- [~maropu] Can you also add test cases in

[jira] [Commented] (SPARK-15672) R programming guide update

[ https://issues.apache.org/jira/browse/SPARK-15672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15309249#comment-15309249 ] Shivaram Venkataraman commented on SPARK-15672: --- Thanks [~GayathriMurali] - This PR can

[jira] [Resolved] (SPARK-8603) In Windows,Not able to create a Spark context from R studio

[ https://issues.apache.org/jira/browse/SPARK-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8603. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-8603) In Windows,Not able to create a Spark context from R studio

[ https://issues.apache.org/jira/browse/SPARK-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8603: - Assignee: Hyukjin Kwon > In Windows,Not able to create a Spark context from R

[jira] [Commented] (SPARK-15585) Don't use null in data source options to indicate default value

[ https://issues.apache.org/jira/browse/SPARK-15585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303523#comment-15303523 ] Shivaram Venkataraman commented on SPARK-15585: --- I am not sure i completely understand the

[jira] [Commented] (SPARK-15684) Not mask startsWith and endsWith in R

[ https://issues.apache.org/jira/browse/SPARK-15684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310566#comment-15310566 ] Shivaram Venkataraman commented on SPARK-15684: --- We just need to match the signature to the

[jira] [Created] (SPARK-15672) R programming guide update

Shivaram Venkataraman created SPARK-15672: - Summary: R programming guide update Key: SPARK-15672 URL: https://issues.apache.org/jira/browse/SPARK-15672 Project: Spark Issue Type:

[jira] [Commented] (SPARK-15672) R programming guide update

[ https://issues.apache.org/jira/browse/SPARK-15672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15307984#comment-15307984 ] Shivaram Venkataraman commented on SPARK-15672: --- cc [~felixcheung] [~sunrui] > R

<    3   4   5   6   7   8   9   10   11   12   >