[jira] [Updated] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2015-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12071: - Labels: releasenotes (was: ) > Programming guide should explain NULL in JVM translate to NA in

[jira] [Commented] (SPARK-11886) R function name conflicts with base or stats package ones

2015-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037251#comment-15037251 ] Felix Cheung commented on SPARK-11886: -- Created SPARK-12116 for dplyr conflicts > R function name

[jira] [Created] (SPARK-12116) Document workaround when method conflicts with another R package, like dplyr

2015-12-02 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12116: Summary: Document workaround when method conflicts with another R package, like dplyr Key: SPARK-12116 URL: https://issues.apache.org/jira/browse/SPARK-12116

[jira] [Comment Edited] (SPARK-11886) R function name conflicts with base or stats package ones

2015-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037251#comment-15037251 ] Felix Cheung edited comment on SPARK-11886 at 12/3/15 4:51 AM: --- Created

[jira] [Updated] (SPARK-12116) Document workaround when method conflicts with another R package, like dplyr

2015-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12116: - Description: See https://issues.apache.org/jira/browse/SPARK-11886 > Document workaround when

[jira] [Commented] (SPARK-12144) Implement DataFrameReader and DataFrameWriter API in SparkR

2015-12-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042103#comment-15042103 ] Felix Cheung commented on SPARK-12144: -- +1 [~shivaram] The style {code}

[jira] [Created] (SPARK-12168) Need test for masked function

2015-12-06 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12168: Summary: Need test for masked function Key: SPARK-12168 URL: https://issues.apache.org/jira/browse/SPARK-12168 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-12172) Remove SparkR internal RDD APIs

2015-12-06 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12172: Summary: Remove SparkR internal RDD APIs Key: SPARK-12172 URL: https://issues.apache.org/jira/browse/SPARK-12172 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-12173) Consider supporting DataSet API in SparkR

2015-12-06 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12173: Summary: Consider supporting DataSet API in SparkR Key: SPARK-12173 URL: https://issues.apache.org/jira/browse/SPARK-12173 Project: Spark Issue Type:

[jira] [Commented] (SPARK-12169) SparkR 2.0

2015-12-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044390#comment-15044390 ] Felix Cheung commented on SPARK-12169: -- Great thanks for opening this. I think we should definitely

[jira] [Updated] (SPARK-12168) Need test for conflicted function in R

2015-12-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12168: - Summary: Need test for conflicted function in R (was: Need test for masked function) > Need

[jira] [Updated] (SPARK-12168) Need test for masked function

2015-12-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12168: - Description: Currently it is hard to know if a function in base or stats packages are masked

[jira] [Commented] (SPARK-12169) SparkR 2.0

2015-12-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044394#comment-15044394 ] Felix Cheung commented on SPARK-12169: -- For those who's reading - we shouldn't open PR yet. See

[jira] [Commented] (SPARK-12224) R support for JDBC source

2015-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047868#comment-15047868 ] Felix Cheung commented on SPARK-12224: -- I'm working on this. > R support for JDBC source >

[jira] [Created] (SPARK-12224) R support for JDBC source

2015-12-08 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12224: Summary: R support for JDBC source Key: SPARK-12224 URL: https://issues.apache.org/jira/browse/SPARK-12224 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12232) Consider exporting read.table in R

2015-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12232: - Summary: Consider exporting read.table in R (was: Consider exporting in R read.table) >

[jira] [Comment Edited] (SPARK-12232) Consider exporting read.table in R

2015-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048039#comment-15048039 ] Felix Cheung edited comment on SPARK-12232 at 12/9/15 5:22 AM: --- WIP here:

[jira] [Commented] (SPARK-12232) Consider exporting read.table in R

2015-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048039#comment-15048039 ] Felix Cheung commented on SPARK-12232: -- WIP here:

[jira] [Commented] (SPARK-12232) Consider exporting read.table in R

2015-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048195#comment-15048195 ] Felix Cheung commented on SPARK-12232: -- right, but then table() is confusing as well. R's notion of

[jira] [Created] (SPARK-12232) Consider exporting in R read.table

2015-12-08 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12232: Summary: Consider exporting in R read.table Key: SPARK-12232 URL: https://issues.apache.org/jira/browse/SPARK-12232 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12235) Enhance mutate() to support replace existing columns

2015-12-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048204#comment-15048204 ] Felix Cheung commented on SPARK-12235: -- Is this related to

[jira] [Commented] (SPARK-12235) Enhance mutate() to support replace existing columns

2015-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049217#comment-15049217 ] Felix Cheung commented on SPARK-12235: -- Please see https://github.com/apache/spark/pull/8503 >

[jira] [Updated] (SPARK-12148) SparkR: rename DataFrame to SparkDataFrame

2015-12-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12148: - Component/s: SparkR > SparkR: rename DataFrame to SparkDataFrame >

[jira] [Updated] (SPARK-12019) SparkR.init does not support character vector for sparkJars and sparkPackages

2015-12-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12019: - Affects Version/s: 1.4.0 1.4.1 > SparkR.init does not support character

[jira] [Commented] (SPARK-10894) Add 'drop' support for DataFrame's subset function

2015-12-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035090#comment-15035090 ] Felix Cheung commented on SPARK-10894: -- These seem like orthogonal things. I don't know if it is

[jira] [Updated] (SPARK-12172) Consider removing SparkR internal RDD APIs

2015-12-07 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12172: - Summary: Consider removing SparkR internal RDD APIs (was: Remove SparkR internal RDD APIs) >

[jira] [Commented] (SPARK-12172) Consider removing SparkR internal RDD APIs

2015-12-07 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046369#comment-15046369 ] Felix Cheung commented on SPARK-12172: -- Sure. What are the uses for RDD stuff you have in mind? >

[jira] [Commented] (SPARK-12232) Consider exporting read.table in R

2015-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049743#comment-15049743 ] Felix Cheung commented on SPARK-12232: -- table() is not on DataFrame, it's with SQLContext which is

[jira] [Commented] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2015-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050104#comment-15050104 ] Felix Cheung commented on SPARK-12071: -- Release note:

[jira] [Comment Edited] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056995#comment-15056995 ] Felix Cheung edited comment on SPARK-12327 at 12/14/15 11:51 PM: - "# void

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056995#comment-15056995 ] Felix Cheung commented on SPARK-12327: -- "# void -> NULL" is another example - they are not code >

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056994#comment-15056994 ] Felix Cheung commented on SPARK-12327: -- yea, I think these are overactive checks in lint-r that I

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

2015-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057368#comment-15057368 ] Felix Cheung commented on SPARK-11255: -- Is this test error caused by this?

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057364#comment-15057364 ] Felix Cheung commented on SPARK-12327: -- In fact [~yu_ishikawa] did open a PR for a subset of these

[jira] [Commented] (SPARK-12232) Consider exporting read.table in R

2015-12-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15054003#comment-15054003 ] Felix Cheung commented on SPARK-12232: -- agreed, `sqlTableToDF` would make sense. > Consider

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059510#comment-15059510 ] Felix Cheung commented on SPARK-12327: -- re: PR to lintr:

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.2

2015-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059515#comment-15059515 ] Felix Cheung commented on SPARK-11255: -- [~joshrosen] was there a specific change in R 3.1.2 that you

[jira] [Commented] (SPARK-10312) Enhance SerDe to handle atomic vector

2015-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059537#comment-15059537 ] Felix Cheung commented on SPARK-10312: -- I think method implementation could easily handle this. ie.

[jira] [Commented] (SPARK-12172) Consider removing SparkR internal RDD APIs

2015-12-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059550#comment-15059550 ] Felix Cheung commented on SPARK-12172: -- That's a great point. [~shivaram] should

[jira] [Updated] (SPARK-12232) Create new R API for read.table to avoid conflict

2015-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12232: - Summary: Create new R API for read.table to avoid conflict (was: Consider exporting read.table

[jira] [Commented] (SPARK-12609) Make R to JVM timeout configurable

2016-01-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081686#comment-15081686 ] Felix Cheung commented on SPARK-12609: -- Shouldn't we have a "in-progress" update ping or something

[jira] [Commented] (SPARK-12625) SparkR is using deprecated APIs

2016-01-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081903#comment-15081903 ] Felix Cheung commented on SPARK-12625: -- Is this the complete set of API to be removed? I took a look

[jira] [Commented] (SPARK-12609) Make R to JVM timeout configurable

2016-01-05 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083506#comment-15083506 ] Felix Cheung commented on SPARK-12609: -- It looks like the timeout to socketConnection is merely the

[jira] [Commented] (SPARK-11139) Make SparkContext.stop() exception-safe

2016-01-05 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085172#comment-15085172 ] Felix Cheung commented on SPARK-11139: -- it looks like this might have been resolved by

[jira] [Updated] (SPARK-5162) Python yarn-cluster mode

2016-01-07 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-5162: Description: 2Running pyspark in yarn is currently limited to ‘yarn-client’ mode. It would be

[jira] [Created] (SPARK-12699) R driver process should start in a clean state

2016-01-07 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12699: Summary: R driver process should start in a clean state Key: SPARK-12699 URL: https://issues.apache.org/jira/browse/SPARK-12699 Project: Spark Issue Type:

[jira] [Updated] (SPARK-5162) Python yarn-cluster mode

2016-01-07 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-5162: Description: Running pyspark in yarn is currently limited to ‘yarn-client’ mode. It would be great

[jira] [Commented] (SPARK-12360) Support using 64-bit long type in SparkR

2015-12-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15065207#comment-15065207 ] Felix Cheung commented on SPARK-12360: -- +1 string. How would parse error (eg. should be int but

[jira] [Created] (SPARK-12534) Document missing command line options to Spark properties mapping

2015-12-27 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12534: Summary: Document missing command line options to Spark properties mapping Key: SPARK-12534 URL: https://issues.apache.org/jira/browse/SPARK-12534 Project: Spark

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067575#comment-15067575 ] Felix Cheung commented on SPARK-12327: -- https://github.com/apache/spark/pull/10408 > lint-r checks

[jira] [Created] (SPARK-12515) Minor clarification on DataFrameReader.jdbc doc

2015-12-23 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12515: Summary: Minor clarification on DataFrameReader.jdbc doc Key: SPARK-12515 URL: https://issues.apache.org/jira/browse/SPARK-12515 Project: Spark Issue Type:

[jira] [Commented] (SPARK-11886) R function name conflicts with base or stats package ones

2015-11-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022787#comment-15022787 ] Felix Cheung commented on SPARK-11886: -- We could also create a generic function to redirect the more

[jira] [Created] (SPARK-12029) Improve column functions signature, param check, tests, fix doc and add examples

2015-11-27 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12029: Summary: Improve column functions signature, param check, tests, fix doc and add examples Key: SPARK-12029 URL: https://issues.apache.org/jira/browse/SPARK-12029

[jira] [Commented] (SPARK-11886) R function name conflicts with base or stats package ones

2015-11-27 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030229#comment-15030229 ] Felix Cheung commented on SPARK-11886: -- SPARK-12025 renamed several functions that are now masking

[jira] [Created] (SPARK-11984) Typos in GroupedData Pivot doc in Scala and Python

2015-11-25 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-11984: Summary: Typos in GroupedData Pivot doc in Scala and Python Key: SPARK-11984 URL: https://issues.apache.org/jira/browse/SPARK-11984 Project: Spark Issue

[jira] [Updated] (SPARK-12019) SparkR.init have wrong example

2015-11-29 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12019: - Component/s: SparkR > SparkR.init have wrong example > -- > >

[jira] [Commented] (SPARK-11886) R function name conflicts with base or stats package ones

2015-11-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032810#comment-15032810 ] Felix Cheung commented on SPARK-11886: -- I see this if I load dplyr after SparkR {code} >

[jira] [Created] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2015-11-30 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12071: Summary: Programming guide should explain NULL in JVM translate to NA in R Key: SPARK-12071 URL: https://issues.apache.org/jira/browse/SPARK-12071 Project: Spark

[jira] [Commented] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2015-11-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033227#comment-15033227 ] Felix Cheung commented on SPARK-12071: -- See PR

[jira] [Comment Edited] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2015-11-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033227#comment-15033227 ] Felix Cheung edited comment on SPARK-12071 at 12/1/15 7:07 AM: --- See commit

[jira] [Created] (SPARK-11886) R function name conflicts with base or stats package ones

2015-11-20 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-11886: Summary: R function name conflicts with base or stats package ones Key: SPARK-11886 URL: https://issues.apache.org/jira/browse/SPARK-11886 Project: Spark

[jira] [Updated] (SPARK-11886) R function name conflicts with base or stats package ones

2015-11-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-11886: - Description: See https://github.com/apache/spark/pull/9785 Currently these are masked:

[jira] [Commented] (SPARK-15344) Unable to set default log level for PySpark

2016-06-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15314907#comment-15314907 ] Felix Cheung commented on SPARK-15344: -- There are two ways to change the default. 1) As in the

[jira] [Commented] (SPARK-13174) Add API and options for csv data sources

2016-06-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316789#comment-15316789 ] Felix Cheung commented on SPARK-13174: -- This hasn't said to be R specific - but in the context of PR

[jira] [Commented] (SPARK-13174) Add API and options for csv data sources

2016-06-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316792#comment-15316792 ] Felix Cheung commented on SPARK-13174: -- instead we should make sure "csv" source is still accessible

[jira] [Commented] (SPARK-15159) SparkSession R API

2016-06-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316802#comment-15316802 ] Felix Cheung commented on SPARK-15159: -- [~shivaram] I am - but trying to have full back

[jira] [Commented] (SPARK-15545) R remove non-exported unused methods, like jsonRDD

2016-06-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315038#comment-15315038 ] Felix Cheung commented on SPARK-15545: -- I think that's mostly right - the RDD related methods are

[jira] [Commented] (SPARK-15439) Failed to run unit test in SparkR

2016-05-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299432#comment-15299432 ] Felix Cheung commented on SPARK-15439: -- Possibly with R version or package versions. Can you check

[jira] [Updated] (SPARK-15545) R remove non-exported unused methods, like jsonRDD

2016-05-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-15545: - Description: Need to review what should be removed. one reason to not remove this right away is

[jira] [Created] (SPARK-15637) SparkR tests failing on R 3.2.2

2016-05-27 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-15637: Summary: SparkR tests failing on R 3.2.2 Key: SPARK-15637 URL: https://issues.apache.org/jira/browse/SPARK-15637 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-15545) R remove non-exported unused methods, like jsonRDD

2016-05-25 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-15545: Summary: R remove non-exported unused methods, like jsonRDD Key: SPARK-15545 URL: https://issues.apache.org/jira/browse/SPARK-15545 Project: Spark Issue

[jira] [Commented] (SPARK-15439) Failed to run unit test in SparkR

2016-05-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301735#comment-15301735 ] Felix Cheung commented on SPARK-15439: -- I think we have an issue here - I"m running R 3.2.2 and the

[jira] [Comment Edited] (SPARK-15439) Failed to run unit test in SparkR

2016-05-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301735#comment-15301735 ] Felix Cheung edited comment on SPARK-15439 at 5/26/16 8:22 AM: --- I think we

[jira] [Commented] (SPARK-16090) Improve method grouping in SparkR generated docs

2016-06-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341436#comment-15341436 ] Felix Cheung commented on SPARK-16090: -- statfunction: https://github.com/apache/spark/pull/13803 >

[jira] [Created] (SPARK-16096) R deprecate unionAll and add union

2016-06-21 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-16096: Summary: R deprecate unionAll and add union Key: SPARK-16096 URL: https://issues.apache.org/jira/browse/SPARK-16096 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-15124) R 2.0 QA: New R APIs and API docs

2016-06-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343810#comment-15343810 ] Felix Cheung commented on SPARK-15124: -- I think both of these are updated now. > R 2.0 QA: New R

[jira] [Updated] (SPARK-16088) Update setJobGroup, clearJobGroup, cancelJobGroup SparkR API to not require sc

2016-06-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-16088: - Summary: Update setJobGroup, clearJobGroup, cancelJobGroup SparkR API to not require sc (was:

[jira] [Commented] (SPARK-16088) Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343807#comment-15343807 ] Felix Cheung commented on SPARK-16088: -- Right, since they are S3 methods there really isn't any

[jira] [Commented] (SPARK-16090) Improve method grouping in SparkR generated docs

2016-06-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341367#comment-15341367 ] Felix Cheung commented on SPARK-16090: -- Ok, I reviewed all 200+ html pages generated and on all of

[jira] [Comment Edited] (SPARK-16090) Improve method grouping in SparkR generated docs

2016-06-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341367#comment-15341367 ] Felix Cheung edited comment on SPARK-16090 at 6/21/16 8:34 AM: --- Ok, I

[jira] [Commented] (SPARK-16090) Improve method grouping in SparkR generated docs

2016-06-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342696#comment-15342696 ] Felix Cheung commented on SPARK-16090: -- This is for example the html output for gapply {code} # S4

[jira] [Commented] (SPARK-16090) Improve method grouping in SparkR generated docs

2016-06-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342474#comment-15342474 ] Felix Cheung commented on SPARK-16090: -- sounds like we only need to review the doc for gapply -

[jira] [Comment Edited] (SPARK-16090) Improve method grouping in SparkR generated docs

2016-06-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342696#comment-15342696 ] Felix Cheung edited comment on SPARK-16090 at 6/21/16 9:08 PM: --- This is for

[jira] [Commented] (SPARK-16028) Remove the need to pass in a SparkContext for spark.lapply

2016-06-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337475#comment-15337475 ] Felix Cheung commented on SPARK-16028: -- Fix ready as soon as the parent PR is merged. > Remove the

[jira] [Commented] (SPARK-16027) Fix SparkR session unit test

2016-06-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337476#comment-15337476 ] Felix Cheung commented on SPARK-16027: -- Fix ready as soon as parent PR is merged. > Fix SparkR

[jira] [Commented] (SPARK-16088) Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341126#comment-15341126 ] Felix Cheung commented on SPARK-16088: -- Not clear what should be the right behavior but

[jira] [Created] (SPARK-16088) Remove setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-16088: Summary: Remove setJobGroup, clearJobGroup, cancelJobGroup from SparkR API Key: SPARK-16088 URL: https://issues.apache.org/jira/browse/SPARK-16088 Project: Spark

[jira] [Updated] (SPARK-16088) Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-16088: - Summary: Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API (was: Remove

[jira] [Updated] (SPARK-16088) Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-16088: - Description: Since they uses SparkContext? > Deprecate setJobGroup, clearJobGroup,

[jira] [Commented] (SPARK-16088) Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341263#comment-15341263 ] Felix Cheung commented on SPARK-16088: -- It's possible - both setLogLevel and spark.lapply are new in

[jira] [Comment Edited] (SPARK-16088) Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341263#comment-15341263 ] Felix Cheung edited comment on SPARK-16088 at 6/21/16 7:10 AM: --- It's

[jira] [Commented] (SPARK-16090) Improve method grouping in SparkR generated docs

2016-06-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341267#comment-15341267 ] Felix Cheung commented on SPARK-16090: -- +1 on that! > Improve method grouping in SparkR generated

[jira] [Created] (SPARK-16184) Support SparkSession.conf API in SparkR

2016-06-24 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-16184: Summary: Support SparkSession.conf API in SparkR Key: SPARK-16184 URL: https://issues.apache.org/jira/browse/SPARK-16184 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12343) Remove YARN Client / ClientArguments

2016-01-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103915#comment-15103915 ] Felix Cheung commented on SPARK-12343: -- Should deploy/Client be separately removed too?

[jira] [Commented] (SPARK-12790) Remove HistoryServer old multiple files format

2016-01-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103856#comment-15103856 ] Felix Cheung commented on SPARK-12790: -- is this simply removing the code path with

[jira] [Created] (SPARK-12862) Jenkins does not run R tests

2016-01-17 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12862: Summary: Jenkins does not run R tests Key: SPARK-12862 URL: https://issues.apache.org/jira/browse/SPARK-12862 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12862) Jenkins does not run R tests

2016-01-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103633#comment-15103633 ] Felix Cheung commented on SPARK-12862: -- mail thread:

[jira] [Commented] (SPARK-12984) Not able to read CSV file using Spark 1.4.0

2016-01-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116645#comment-15116645 ] Felix Cheung commented on SPARK-12984: -- You should specify 'source' - otherwise it defaults to

[jira] [Commented] (SPARK-12344) Remove env-based configurations

2016-02-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127794#comment-15127794 ] Felix Cheung commented on SPARK-12344: -- I think we should remove `SPARK_YARN_USER_ENV` as well.

[jira] [Commented] (SPARK-13525) SparkR: java.net.SocketTimeoutException: Accept timed out when running any dataframe function

2016-02-27 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15170860#comment-15170860 ] Felix Cheung commented on SPARK-13525: -- It's odd that `head` is not exported. Could you try running

<    1   2   3   4   5   6   7   8   9   10   >