[jira] [Resolved] (SPARK-8847) String concatination with column in SparkR

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8847. -- Resolution: Duplicate Fix Version/s: 1.5.0 String concatination with

[jira] [Updated] (SPARK-10007) Update `NAMESPACE` file in SparkR for simple parameters functions

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10007: -- Assignee: Yu Ishikawa Update `NAMESPACE` file in SparkR for simple parameters

[jira] [Resolved] (SPARK-10007) Update `NAMESPACE` file in SparkR for simple parameters functions

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10007. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Commented] (SPARK-9427) Add expression functions in SparkR

2015-08-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700058#comment-14700058 ] Shivaram Venkataraman commented on SPARK-9427: -- Well half of the functions

[jira] [Commented] (SPARK-10043) Add window functions into SparkR

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699032#comment-14699032 ] Shivaram Venkataraman commented on SPARK-10043: --- [~yuu.ishik...@gmail.com]

[jira] [Updated] (SPARK-9871) Add expression functions into SparkR which have a variable parameter

2015-08-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9871: - Assignee: Yu Ishikawa Add expression functions into SparkR which have a variable

[jira] [Resolved] (SPARK-9871) Add expression functions into SparkR which have a variable parameter

2015-08-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9871. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Commented] (SPARK-9427) Add expression functions in SparkR

2015-08-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699080#comment-14699080 ] Shivaram Venkataraman commented on SPARK-9427: -- Yeah I think the simplest

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606293#comment-14606293 ] Shivaram Venkataraman commented on SPARK-8684: -- The create_image.sh script is

[jira] [Commented] (SPARK-8699) Select command not working for SparkR built on Spark Version: 1.4.0 and R 3.2.0

2015-06-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608597#comment-14608597 ] Shivaram Venkataraman commented on SPARK-8699: -- I can't reproduce this. My

[jira] [Commented] (SPARK-8724) Need documentation on how to deploy or use SparkR in Spark 1.4.0+

2015-06-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608573#comment-14608573 ] Shivaram Venkataraman commented on SPARK-8724: -- I'm not sure what kind of

[jira] [Commented] (SPARK-8277) SparkR createDataFrame is slow

2015-06-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608689#comment-14608689 ] Shivaram Venkataraman commented on SPARK-8277: -- Yeah so the bottleneck is in

[jira] [Commented] (SPARK-7210) Test matrix decompositions for speed vs. numerical stability for Gaussians

2015-06-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609002#comment-14609002 ] Shivaram Venkataraman commented on SPARK-7210: -- A more stable way would

[jira] [Commented] (SPARK-7210) Test matrix decompositions for speed vs. numerical stability for Gaussians

2015-06-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609052#comment-14609052 ] Shivaram Venkataraman commented on SPARK-7210: -- Sorry I think I misunderstood

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609054#comment-14609054 ] Shivaram Venkataraman commented on SPARK-8684: -- Building from source might

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609148#comment-14609148 ] Shivaram Venkataraman commented on SPARK-8596: -- I think the assumption is

[jira] [Updated] (SPARK-6803) [SparkR] Support SparkR Streaming

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6803: - Target Version/s: (was: 1.5.0) [SparkR] Support SparkR Streaming

[jira] [Commented] (SPARK-6823) Add a model.matrix like capability to DataFrames (modelDataFrame)

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651196#comment-14651196 ] Shivaram Venkataraman commented on SPARK-6823: -- [~ekhliang] [~mengxr] Is this

[jira] [Updated] (SPARK-6816) Add SparkConf API to configure SparkR

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6816: - Target Version/s: (was: 1.5.0) Add SparkConf API to configure SparkR

[jira] [Updated] (SPARK-6832) Handle partial reads in SparkR JVM to worker communication

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6832: - Target Version/s: (was: 1.5.0) Handle partial reads in SparkR JVM to worker

[jira] [Updated] (SPARK-6821) Refactor SerDe API in SparkR to be more developer friendly

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6821: - Target Version/s: (was: 1.5.0) Refactor SerDe API in SparkR to be more

[jira] [Commented] (SPARK-9319) Add support for setting column names, types

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651193#comment-14651193 ] Shivaram Venkataraman commented on SPARK-9319: -- [~falaki] I believe we

[jira] [Commented] (SPARK-6798) Fix Date serialization in SparkR

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651199#comment-14651199 ] Shivaram Venkataraman commented on SPARK-6798: -- [~davies] Do you remember if

[jira] [Updated] (SPARK-6809) Make numPartitions optional in pairRDD APIs

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6809: - Target Version/s: (was: 1.5.0) Make numPartitions optional in pairRDD APIs

[jira] [Updated] (SPARK-6815) Support accumulators in R

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6815: - Target Version/s: (was: 1.5.0) Support accumulators in R

[jira] [Updated] (SPARK-6838) Explore using Reference Classes instead of S4 objects

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6838: - Target Version/s: (was: 1.5.0) Explore using Reference Classes instead of S4

[jira] [Updated] (SPARK-8082) Functionality to Reset DF Schemas/Cast Multiple Columns

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8082: - Target Version/s: (was: 1.5.0) Functionality to Reset DF Schemas/Cast Multiple

[jira] [Updated] (SPARK-6810) Performance benchmarks for SparkR

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6810: - Target Version/s: (was: 1.5.0) Performance benchmarks for SparkR

[jira] [Updated] (SPARK-6825) Data sources implementation to support `sequenceFile`

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6825: - Target Version/s: (was: 1.5.0) Data sources implementation to support

[jira] [Commented] (SPARK-6831) Document how to use external data sources

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651198#comment-14651198 ] Shivaram Venkataraman commented on SPARK-6831: -- [~yhuai] Is this something we

[jira] [Updated] (SPARK-8684) Update R version in Spark EC2 AMI

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8684: - Target Version/s: (was: 1.5.0) Update R version in Spark EC2 AMI

[jira] [Updated] (SPARK-9443) Expose sampleByKey in SparkR

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9443: - Summary: Expose sampleByKey in SparkR (was: Explose sampleByKey in SparkR)

[jira] [Resolved] (SPARK-9053) Fix spaces around parens, infix operators etc.

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9053. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-9053) Fix spaces around parens, infix operators etc.

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9053: - Assignee: Yu Ishikawa Fix spaces around parens, infix operators etc.

[jira] [Created] (SPARK-9510) Fix remaining SparkR style violations

2015-07-31 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9510: Summary: Fix remaining SparkR style violations Key: SPARK-9510 URL: https://issues.apache.org/jira/browse/SPARK-9510 Project: Spark Issue

[jira] [Updated] (SPARK-8742) Improve SparkR error messages for DataFrame API

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8742: - Assignee: Hossein Falaki Improve SparkR error messages for DataFrame API

[jira] [Resolved] (SPARK-8742) Improve SparkR error messages for DataFrame API

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8742. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Assigned] (SPARK-9510) Fix remaining SparkR style violations

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-9510: Assignee: Shivaram Venkataraman Fix remaining SparkR style violations

[jira] [Updated] (SPARK-9324) Add `unique` as a synonym for `distinct`

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9324: - Assignee: Hossein Falaki Add `unique` as a synonym for `distinct`

[jira] [Resolved] (SPARK-9510) Fix remaining SparkR style violations

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9510. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-9322) Add rbind as a synonym for `unionAll`

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9322: - Assignee: Hossein Falaki Add rbind as a synonym for `unionAll`

[jira] [Resolved] (SPARK-9321) Add nrow, ncol, dim for SparkR data frames

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9321. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-9321) Add nrow, ncol, dim for SparkR data frames

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9321: - Assignee: Hossein Falaki Add nrow, ncol, dim for SparkR data frames

[jira] [Resolved] (SPARK-9322) Add rbind as a synonym for `unionAll`

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9322. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-9324) Add `unique` as a synonym for `distinct`

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9324. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Created] (SPARK-9562) Move spark-ec2 from mesos to amplab

2015-08-03 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9562: Summary: Move spark-ec2 from mesos to amplab Key: SPARK-9562 URL: https://issues.apache.org/jira/browse/SPARK-9562 Project: Spark Issue

[jira] [Updated] (SPARK-9248) Closing curly-braces should always be on their own line

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9248: - Assignee: Yu Ishikawa Closing curly-braces should always be on their own line

[jira] [Resolved] (SPARK-9248) Closing curly-braces should always be on their own line

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9248. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Commented] (SPARK-9437) SizeEstimator overflows for primitive arrays

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648025#comment-14648025 ] Shivaram Venkataraman commented on SPARK-9437: -- Resolved by

[jira] [Resolved] (SPARK-9437) SizeEstimator overflows for primitive arrays

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9437. -- Resolution: Fixed Fix Version/s: 1.5.0 SizeEstimator overflows for

[jira] [Commented] (SPARK-8724) Need documentation on how to deploy or use SparkR in Spark 1.4.0+

2015-08-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682219#comment-14682219 ] Shivaram Venkataraman commented on SPARK-8724: -- [~cantdutchthis] One thing we

[jira] [Assigned] (SPARK-9562) Move spark-ec2 from mesos to amplab

2015-08-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-9562: Assignee: Shivaram Venkataraman Move spark-ec2 from mesos to amplab

[jira] [Resolved] (SPARK-9562) Move spark-ec2 from mesos to amplab

2015-08-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9562. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-9603) Re-enable complex R package test in SparkSubmitSuite

2015-08-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9603: - Component/s: SparkR Re-enable complex R package test in SparkSubmitSuite

[jira] [Commented] (SPARK-9605) SparkR installation error: Error: Invalid or corrupt jarfile sbt/sbt-launch-0.13.6.jar

2015-08-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654073#comment-14654073 ] Shivaram Venkataraman commented on SPARK-9605: -- The amplab version of SparkR

[jira] [Commented] (SPARK-9605) SparkR installation error: Error: Invalid or corrupt jarfile sbt/sbt-launch-0.13.6.jar

2015-08-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654149#comment-14654149 ] Shivaram Venkataraman commented on SPARK-9605: -- You don't need to install

[jira] [Resolved] (SPARK-9605) SparkR installation error: Error: Invalid or corrupt jarfile sbt/sbt-launch-0.13.6.jar

2015-08-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9605. -- Resolution: Not A Problem SparkR installation error: Error: Invalid or corrupt

[jira] [Commented] (SPARK-9972) Add `struct` function in SparkR

2015-08-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14697232#comment-14697232 ] Shivaram Venkataraman commented on SPARK-9972: -- Yeah this can be marked as

[jira] [Updated] (SPARK-7420) Flaky test: o.a.s.streaming.JobGeneratorSuite Do not clear received block data too soon

2015-08-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7420: - Labels: flaky-test (was: ) Flaky test: o.a.s.streaming.JobGeneratorSuite Do not

[jira] [Resolved] (SPARK-9710) RPackageUtilsSuite fails if R is not installed

2015-08-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9710. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-9710) RPackageUtilsSuite fails if R is not installed

2015-08-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9710: - Assignee: Marcelo Vanzin RPackageUtilsSuite fails if R is not installed

[jira] [Commented] (SPARK-9972) Add `struct`, `encode` and `decode` function in SparkR

2015-08-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14698012#comment-14698012 ] Shivaram Venkataraman commented on SPARK-9972: -- [~yuu.ishik...@gmail.com] Why

[jira] [Commented] (SPARK-9427) Add expression functions in SparkR

2015-08-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692662#comment-14692662 ] Shivaram Venkataraman commented on SPARK-9427: -- [~yuu.ishik...@gmail.com]

[jira] [Commented] (SPARK-9865) Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

2015-08-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693814#comment-14693814 ] Shivaram Venkataraman commented on SPARK-9865: -- So we sample 10% in a

[jira] [Resolved] (SPARK-8313) Support Spark Packages containing R code with --packages

2015-08-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8313. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-8313) Support Spark Packages containing R code with --packages

2015-08-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8313: - Assignee: Burak Yavuz Support Spark Packages containing R code with --packages

[jira] [Commented] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

2015-07-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635300#comment-14635300 ] Shivaram Venkataraman commented on SPARK-9121: -- Yeah we can add

[jira] [Commented] (SPARK-9053) Fix spaces around parens, infix operators etc.

2015-07-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636060#comment-14636060 ] Shivaram Venkataraman commented on SPARK-9053: -- Yeah - there are a bunch of

[jira] [Resolved] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

2015-07-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9121. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

2015-07-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9121: - Assignee: Yu Ishikawa Get rid of the warnings about `no visible global function

[jira] [Commented] (SPARK-9230) SparkR RFormula should support StringType features

2015-07-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635776#comment-14635776 ] Shivaram Venkataraman commented on SPARK-9230: -- [~ekhliang] [~mengxr] One

[jira] [Commented] (SPARK-9230) SparkR RFormula should support StringType features

2015-07-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635796#comment-14635796 ] Shivaram Venkataraman commented on SPARK-9230: -- The thing to do there would

[jira] [Created] (SPARK-9322) Add rbind as a synonym for `unionAll`

2015-07-24 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9322: Summary: Add rbind as a synonym for `unionAll` Key: SPARK-9322 URL: https://issues.apache.org/jira/browse/SPARK-9322 Project: Spark Issue

[jira] [Resolved] (SPARK-8364) Add crosstab to SparkR DataFrames

2015-07-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8364. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-8807) Add between operator in SparkR

2015-07-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8807. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-8807) Add between operator in SparkR

2015-07-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8807: - Assignee: Liang-Chi Hsieh Add between operator in SparkR

[jira] [Created] (SPARK-9053) Fix spaces around parens, infix operators etc.

2015-07-14 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9053: Summary: Fix spaces around parens, infix operators etc. Key: SPARK-9053 URL: https://issues.apache.org/jira/browse/SPARK-9053 Project: Spark

[jira] [Updated] (SPARK-8808) Fix assignments in SparkR

2015-07-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8808: - Assignee: Sun Rui Fix assignments in SparkR -

[jira] [Resolved] (SPARK-8808) Fix assignments in SparkR

2015-07-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8808. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Created] (SPARK-9052) Fix comments after curly braces

2015-07-14 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9052: Summary: Fix comments after curly braces Key: SPARK-9052 URL: https://issues.apache.org/jira/browse/SPARK-9052 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

2015-07-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631590#comment-14631590 ] Shivaram Venkataraman commented on SPARK-9121: -- [~yuu.ishik...@gmail.com] I

[jira] [Resolved] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8596. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Commented] (SPARK-8952) JsonFile() of SQLContext display improper warning message for a S3 path

2015-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624781#comment-14624781 ] Shivaram Venkataraman commented on SPARK-8952: -- So the reason normalizePath

[jira] [Updated] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8596: - Assignee: Vincent Warmerdam Install and configure RStudio server on Spark EC2

[jira] [Resolved] (SPARK-6797) Add support for YARN cluster mode

2015-07-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6797. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-9201) Integrate MLlib with SparkR using RFormula

2015-07-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9201. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Commented] (SPARK-9121) Get rid of the warnings about `no visible global function definition` in SparkR

2015-07-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14634626#comment-14634626 ] Shivaram Venkataraman commented on SPARK-9121: -- Yeah - we can just call

[jira] [Commented] (SPARK-10219) Error when additional options provided as variable in write.df

2015-08-25 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14711642#comment-14711642 ] Shivaram Venkataraman commented on SPARK-10219: --- I think thats happening

[jira] [Created] (SPARK-10214) Improve SparkR Column, DataFrame API docs

2015-08-24 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-10214: - Summary: Improve SparkR Column, DataFrame API docs Key: SPARK-10214 URL: https://issues.apache.org/jira/browse/SPARK-10214 Project: Spark

[jira] [Commented] (SPARK-10214) Improve SparkR Column, DataFrame API docs

2015-08-24 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14710404#comment-14710404 ] Shivaram Venkataraman commented on SPARK-10214: --- cc

[jira] [Updated] (SPARK-10118) Improve SparkR API docs for 1.5 release

2015-08-24 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10118: -- Assignee: Yu Ishikawa Improve SparkR API docs for 1.5 release

[jira] [Resolved] (SPARK-10118) Improve SparkR API docs for 1.5 release

2015-08-24 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10118. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

2015-10-24 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972765#comment-14972765 ] Shivaram Venkataraman commented on SPARK-11255: --- cc [~shaneknapp] > R Test build should

[jira] [Commented] (SPARK-11231) join returns schema with duplicated and ambiguous join columns

2015-10-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967364#comment-14967364 ] Shivaram Venkataraman commented on SPARK-11231: --- [~Narine] [~sunrui] Is this covered by

[jira] [Commented] (SPARK-11244) sparkR.stop doesn't clean up .sparkRSQLsc in environment

2015-10-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967778#comment-14967778 ] Shivaram Venkataraman commented on SPARK-11244: --- Good catch -- Could you send a PR for this

[jira] [Commented] (SPARK-11238) SparkR: Documentation change for merge function

2015-10-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967807#comment-14967807 ] Shivaram Venkataraman commented on SPARK-11238: --- Also on this we should mark this as a

[jira] [Updated] (SPARK-11294) Improve R doc for read.df, write.df, saveAsTable

2015-10-25 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11294: -- Fix Version/s: (was: 1.5.2) 1.5.3 > Improve R doc for

[jira] [Updated] (SPARK-11258) Converting a Spark DataFrame into an R data.frame is slow / requires a lot of memory

2015-10-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11258: -- Assignee: Frank Rosner > Converting a Spark DataFrame into an R data.frame is

[jira] [Updated] (SPARK-10979) SparkR: Add merge to DataFrame

2015-10-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10979: -- Assignee: Narine Kokhlikyan > SparkR: Add merge to DataFrame >

[jira] [Resolved] (SPARK-10979) SparkR: Add merge to DataFrame

2015-10-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10979. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

<    1   2   3   4   5   6   7   8   9   10   >