[jira] [Created] (SPARK-8027) SparkR docs should be included in the distribution

2015-06-01 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-8027: Summary: SparkR docs should be included in the distribution Key: SPARK-8027 URL: https://issues.apache.org/jira/browse/SPARK-8027 Project: Spark

[jira] [Resolved] (SPARK-8028) SparkR does not work with `--jars` and `--packages`

2015-06-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8028. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-8027) SparkR docs should be included in the distribution

2015-06-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8027. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request

[jira] [Updated] (SPARK-7714) SparkR tests should use more specific expectations than expect_true

2015-07-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7714: - Assignee: Sun Rui SparkR tests should use more specific expectations than

[jira] [Resolved] (SPARK-7714) SparkR tests should use more specific expectations than expect_true

2015-07-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-7714. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-6833) Extend `addPackage` so that any given R file can be sourced in the worker before functions are run.

2015-07-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6833. -- Resolution: Fixed Fix Version/s: 1.5.0 Thanks [~sunrui] for checking

[jira] [Commented] (SPARK-8724) Need documentation on how to deploy or use SparkR in Spark 1.4.0+

2015-07-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14610589#comment-14610589 ] Shivaram Venkataraman commented on SPARK-8724: -- Sure. We could add that to

[jira] [Commented] (SPARK-8742) Improve SparkR error messages for DataFrame API

2015-06-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609558#comment-14609558 ] Shivaram Venkataraman commented on SPARK-8742: -- Thanks [~falaki] for creating

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-07-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613277#comment-14613277 ] Shivaram Venkataraman commented on SPARK-8684: -- Yeah I tried to hack on this

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-07-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613273#comment-14613273 ] Shivaram Venkataraman commented on SPARK-8596: -- Some points that might be

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604435#comment-14604435 ] Shivaram Venkataraman commented on SPARK-6813: -- [~cantdutchthis] This style

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604440#comment-14604440 ] Shivaram Venkataraman commented on SPARK-8596: -- Thanks ! These are very

[jira] [Commented] (SPARK-6830) Memoize frequently queried vals in RDD, such as numPartitions, count etc.

2015-06-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604447#comment-14604447 ] Shivaram Venkataraman commented on SPARK-6830: -- The RDD here refers to the

[jira] [Created] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-27 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-8684: Summary: Update R version in Spark EC2 AMI Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type:

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604449#comment-14604449 ] Shivaram Venkataraman commented on SPARK-8684: -- [~cantdutchthis] Continuing

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604897#comment-14604897 ] Shivaram Venkataraman commented on SPARK-8596: -- Merged

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-07-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14614331#comment-14614331 ] Shivaram Venkataraman commented on SPARK-8596: -- I think its fine to make

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-07-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14614348#comment-14614348 ] Shivaram Venkataraman commented on SPARK-8684: -- Hmm - the SparkR being built

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-07-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612193#comment-14612193 ] Shivaram Venkataraman commented on SPARK-8684: -- Its unfortunate that the AWS

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-07-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612178#comment-14612178 ] Shivaram Venkataraman commented on SPARK-8596: -- Thanks [~cantdutchthis] -- To

[jira] [Commented] (SPARK-8124) Created more examples on SparkR DataFrames

2015-07-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615418#comment-14615418 ] Shivaram Venkataraman commented on SPARK-8124: -- Resolved by

[jira] [Resolved] (SPARK-8124) Created more examples on SparkR DataFrames

2015-07-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8124. -- Resolution: Fixed Fix Version/s: 1.5.0 Created more examples on SparkR

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-07-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615675#comment-14615675 ] Shivaram Venkataraman commented on SPARK-8596: -- I think you can move the

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-07-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615264#comment-14615264 ] Shivaram Venkataraman commented on SPARK-8596: -- Hmm the problem is I'm not

[jira] [Updated] (SPARK-8124) Created more examples on SparkR DataFrames

2015-07-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8124: - Assignee: Daniel Emaasit Created more examples on SparkR DataFrames

[jira] [Commented] (SPARK-8844) head/collect is broken in SparkR

2015-07-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615430#comment-14615430 ] Shivaram Venkataraman commented on SPARK-8844: -- Hmm this might be because the

[jira] [Commented] (SPARK-701) Wrong SPARK_MEM setting with different EC2 master and worker machine types

2015-06-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606622#comment-14606622 ] Shivaram Venkataraman commented on SPARK-701: - Yeah so SPARK_MEM used to be

[jira] [Resolved] (SPARK-8699) Select command not working for SparkR built on Spark Version: 1.4.0 and R 3.2.0

2015-06-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8699. -- Resolution: Not A Problem Select command not working for SparkR built on Spark

[jira] [Resolved] (SPARK-8549) Fix the line length of SparkR

2015-07-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8549. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-8549) Fix the line length of SparkR

2015-07-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8549: - Assignee: Yu Ishikawa Fix the line length of SparkR

[jira] [Created] (SPARK-8310) Spark EC2 branch in 1.4 is wrong

2015-06-11 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-8310: Summary: Spark EC2 branch in 1.4 is wrong Key: SPARK-8310 URL: https://issues.apache.org/jira/browse/SPARK-8310 Project: Spark Issue Type:

[jira] [Updated] (SPARK-6797) Add support for YARN cluster mode

2015-05-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6797: - Target Version/s: 1.5.0 (was: 1.4.0) Add support for YARN cluster mode

[jira] [Created] (SPARK-7839) Augment build environment to support native libraries with SparkR

2015-05-22 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-7839: Summary: Augment build environment to support native libraries with SparkR Key: SPARK-7839 URL: https://issues.apache.org/jira/browse/SPARK-7839

[jira] [Resolved] (SPARK-6811) Building binary R packages for SparkR

2015-05-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6811. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-6806) SparkR examples in programming guide

2015-05-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6806. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request

[jira] [Commented] (SPARK-6246) spark-ec2 can't handle clusters with 100 nodes

2015-05-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14550652#comment-14550652 ] Shivaram Venkataraman commented on SPARK-6246: -- Could you send a PR for this

[jira] [Commented] (SPARK-8514) LU factorization on BlockMatrix

2015-07-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615251#comment-14615251 ] Shivaram Venkataraman commented on SPARK-8514: -- I am not sure what the

[jira] [Commented] (SPARK-8832) insertInto() throws error in sparkR

2015-07-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615247#comment-14615247 ] Shivaram Venkataraman commented on SPARK-8832: -- Does this work in Scala /

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-07-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615249#comment-14615249 ] Shivaram Venkataraman commented on SPARK-8684: -- Thanks ! this looks good.

[jira] [Commented] (SPARK-8840) Float type coercion with hiveContext

2015-07-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615234#comment-14615234 ] Shivaram Venkataraman commented on SPARK-8840: -- Does this work in Scala /

[jira] [Commented] (SPARK-8840) Float type coercion with hiveContext

2015-07-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616918#comment-14616918 ] Shivaram Venkataraman commented on SPARK-8840: -- Sorry my question is can you

[jira] [Updated] (SPARK-8821) The ec2 script doesn't run on python 3 with an utf8 env

2015-07-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8821: - Assignee: Simon Hafner The ec2 script doesn't run on python 3 with an utf8 env

[jira] [Resolved] (SPARK-8821) The ec2 script doesn't run on python 3 with an utf8 env

2015-07-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8821. -- Resolution: Fixed Fix Version/s: 1.5.0 1.4.2 Issue

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-07-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616924#comment-14616924 ] Shivaram Venkataraman commented on SPARK-8596: -- You can test this by

[jira] [Resolved] (SPARK-9320) Add `summary` as a synonym for `describe`

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9320. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-9320) Add `summary` as a synonym for `describe`

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9320: - Assignee: Hossein Falaki Add `summary` as a synonym for `describe`

[jira] [Updated] (SPARK-9318) Add `merge` as synonym for join

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9318: - Assignee: Hossein Falaki Add `merge` as synonym for join

[jira] [Resolved] (SPARK-9318) Add `merge` as synonym for join

2015-07-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9318. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Commented] (SPARK-8939) YARN EC2 default setting fails with IllegalArgumentException

2015-08-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651436#comment-14651436 ] Shivaram Venkataraman commented on SPARK-8939: -- [~andrewor14] I ran into this

[jira] [Created] (SPARK-9760) SparkSubmit doesn't work with --packages when --repositories is not specified

2015-08-08 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-9760: Summary: SparkSubmit doesn't work with --packages when --repositories is not specified Key: SPARK-9760 URL: https://issues.apache.org/jira/browse/SPARK-9760

[jira] [Resolved] (SPARK-9855) Add expression functions into SparkR whose params are simple

2015-08-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9855. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-9916) Clear leftover sparkr.zip copies and creations (e.g. make-distribution.sh)

2015-08-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9916: - Assignee: Burak Yavuz Clear leftover sparkr.zip copies and creations (e.g.

[jira] [Resolved] (SPARK-9916) Clear leftover sparkr.zip copies and creations (e.g. make-distribution.sh)

2015-08-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9916. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-8844) head/collect is broken in SparkR

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8844. -- Resolution: Fixed Fix Version/s: 1.5.0 head/collect is broken in SparkR

[jira] [Commented] (SPARK-8844) head/collect is broken in SparkR

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14698564#comment-14698564 ] Shivaram Venkataraman commented on SPARK-8844: -- Resolved by

[jira] [Updated] (SPARK-8844) head/collect is broken in SparkR

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8844: - Assignee: Sun Rui head/collect is broken in SparkR

[jira] [Commented] (SPARK-10079) Make `column` and `col` functions be S4 functions

2015-08-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700706#comment-14700706 ] Shivaram Venkataraman commented on SPARK-10079: --- [~yuu.ishik...@gmail.com]

[jira] [Assigned] (SPARK-9760) SparkSubmit doesn't work with --packages when --repositories is not specified

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-9760: Assignee: Shivaram Venkataraman SparkSubmit doesn't work with --packages

[jira] [Resolved] (SPARK-9760) SparkSubmit doesn't work with --packages when --repositories is not specified

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9760. -- Resolution: Fixed Fix Version/s: 1.5.0 SparkSubmit doesn't work with

[jira] [Commented] (SPARK-9972) Add `struct`, `encode` and `decode` function in SparkR

2015-08-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699823#comment-14699823 ] Shivaram Venkataraman commented on SPARK-9972: -- Ah that makes more sense.

[jira] [Commented] (SPARK-8847) String concatination with column in SparkR

2015-08-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699824#comment-14699824 ] Shivaram Venkataraman commented on SPARK-8847: -- To add a bit more detail here

[jira] [Commented] (SPARK-10051) Support collecting data of StructType in DataFrame

2015-08-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699864#comment-14699864 ] Shivaram Venkataraman commented on SPARK-10051: --- I think `StructType` maps

[jira] [Commented] (SPARK-10050) Support collecting data of MapType in DataFrame

2015-08-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699863#comment-14699863 ] Shivaram Venkataraman commented on SPARK-10050: --- I think the comments in

[jira] [Updated] (SPARK-10118) Improve SparkR API docs for 1.5 release

2015-08-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10118: -- Description: This includes checking if the new DataFrame functions expression

[jira] [Created] (SPARK-10118) Improve SparkR API docs for 1.5 release

2015-08-19 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-10118: - Summary: Improve SparkR API docs for 1.5 release Key: SPARK-10118 URL: https://issues.apache.org/jira/browse/SPARK-10118 Project: Spark

[jira] [Resolved] (SPARK-9856) Add expression functions into SparkR whose params are complicated

2015-08-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9856. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-9856) Add expression functions into SparkR whose params are complicated

2015-08-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9856: - Assignee: Yu Ishikawa Add expression functions into SparkR whose params are

[jira] [Commented] (SPARK-10118) Improve SparkR API docs for 1.5 release

2015-08-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703470#comment-14703470 ] Shivaram Venkataraman commented on SPARK-10118: --- [~rxin] Can you include

[jira] [Commented] (SPARK-10079) Make `column` and `col` functions be S4 functions

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14701898#comment-14701898 ] Shivaram Venkataraman commented on SPARK-10079: --- If we want to make it

[jira] [Updated] (SPARK-10106) Add `ifelse` Column function to SparkR

2015-08-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10106: -- Assignee: Yu Ishikawa Add `ifelse` Column function to SparkR

[jira] [Resolved] (SPARK-10106) Add `ifelse` Column function to SparkR

2015-08-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10106. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Commented] (SPARK-10075) Add `when` expressino function in SparkR

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702382#comment-14702382 ] Shivaram Venkataraman commented on SPARK-10075: --- Resolved by

[jira] [Resolved] (SPARK-10075) Add `when` expressino function in SparkR

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10075. --- Resolution: Fixed Fix Version/s: 1.5.0 Add `when` expressino

[jira] [Updated] (SPARK-10075) Add `when` expressino function in SparkR

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10075: -- Assignee: Yu Ishikawa Add `when` expressino function in SparkR

[jira] [Resolved] (SPARK-9982) SparkR DataFrame fail to return data of Decimal type

2015-08-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9982. -- Resolution: Fixed Fix Version/s: 1.5.0 SparkR DataFrame fail to return

[jira] [Updated] (SPARK-9982) SparkR DataFrame fail to return data of Decimal type

2015-08-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9982: - Assignee: Alex Shkurenko SparkR DataFrame fail to return data of Decimal type

[jira] [Commented] (SPARK-9982) SparkR DataFrame fail to return data of Decimal type

2015-08-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14705328#comment-14705328 ] Shivaram Venkataraman commented on SPARK-9982: -- Resolved by

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

2015-08-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14707120#comment-14707120 ] Shivaram Venkataraman commented on SPARK-9325: -- Yeah that sounds good

[jira] [Commented] (SPARK-10118) Improve SparkR API docs for 1.5 release

2015-08-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14707658#comment-14707658 ] Shivaram Venkataraman commented on SPARK-10118: --- [~yuu.ishik...@gmail.com]

[jira] [Updated] (SPARK-10183) Expose the SparkR backend api

2015-08-24 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10183: -- Component/s: SparkR Expose the SparkR backend api

[jira] [Updated] (SPARK-9857) Add expression functions into SparkR which conflict with the existing R's generic

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9857: - Target Version/s: 1.6.0, 1.5.1 (was: 1.5.0) Add expression functions into

[jira] [Updated] (SPARK-9972) Add `struct`, `encode` and `decode` function in SparkR

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9972: - Target Version/s: 1.6.0, 1.5.1 (was: 1.6.0) Add `struct`, `encode` and `decode`

[jira] [Updated] (SPARK-10079) Make `column` and `col` functions be S4 functions

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10079: -- Target Version/s: 1.6.0, 1.5.1 (was: 1.5.0) Make `column` and `col`

[jira] [Updated] (SPARK-6814) Support sorting for any data type in SparkR

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6814: - Target Version/s: (was: 1.5.0) Support sorting for any data type in SparkR

[jira] [Updated] (SPARK-4888) Spark EC2 doesn't mount local disks for i2.8xlarge instances

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-4888: - Target Version/s: (was: 1.5.0) Spark EC2 doesn't mount local disks for

[jira] [Updated] (SPARK-9427) Add expression functions in SparkR

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9427: - Target Version/s: 1.6.0, 1.5.1 (was: 1.6.0) Add expression functions in SparkR

[jira] [Commented] (SPARK-4888) Spark EC2 doesn't mount local disks for i2.8xlarge instances

2015-08-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702604#comment-14702604 ] Shivaram Venkataraman commented on SPARK-4888: -- Yeah we can definitely do a

[jira] [Updated] (SPARK-9302) collect()/head() failed with JSON of some format

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9302: - Target Version/s: (was: 1.5.0) collect()/head() failed with JSON of some

[jira] [Updated] (SPARK-6798) Fix Date serialization in SparkR

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6798: - Target Version/s: (was: 1.5.0) Fix Date serialization in SparkR

[jira] [Commented] (SPARK-9427) Add expression functions in SparkR

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702519#comment-14702519 ] Shivaram Venkataraman commented on SPARK-9427: -- [~yuu.ishik...@gmail.com] I

[jira] [Updated] (SPARK-6822) lapplyPartition passes empty list to function

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6822: - Target Version/s: (was: 1.5.0) lapplyPartition passes empty list to function

[jira] [Updated] (SPARK-6837) SparkR failure in processClosure

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6837: - Target Version/s: 1.6.0, 1.5.1 (was: 1.5.0) SparkR failure in processClosure

[jira] [Updated] (SPARK-6834) Failed with error: ‘invalid package name’ Error in as.name(name) : attempt to use zero-length variable name

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6834: - Target Version/s: 1.6.0, 1.5.1 (was: 1.5.0) Failed with error: ‘invalid package

[jira] [Updated] (SPARK-6840) SparkR: private package functions unavailable when using lapplyPartition in package

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6840: - Target Version/s: 1.6.0, 1.5.1 (was: 1.5.0) SparkR: private package functions

[jira] [Updated] (SPARK-6826) `hashCode` support for arbitrary R objects

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6826: - Target Version/s: (was: 1.5.0) `hashCode` support for arbitrary R objects

[jira] [Commented] (SPARK-4888) Spark EC2 doesn't mount local disks for i2.8xlarge instances

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702533#comment-14702533 ] Shivaram Venkataraman commented on SPARK-4888: -- I'm removing a target version

[jira] [Updated] (SPARK-9302) collect()/head() failed with JSON of some format

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9302: - Issue Type: Improvement (was: Bug) collect()/head() failed with JSON of some

[jira] [Commented] (SPARK-9302) collect()/head() failed with JSON of some format

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702510#comment-14702510 ] Shivaram Venkataraman commented on SPARK-9302: -- There is a PR open that I

[jira] [Updated] (SPARK-9302) Handle complex JSON types in collect()/head()

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9302: - Summary: Handle complex JSON types in collect()/head() (was: collect()/head()

[jira] [Resolved] (SPARK-6813) SparkR style guide

2015-08-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6813. -- Resolution: Fixed Assignee: Yu Ishikawa Fix Version/s: 1.5.0

<    1   2   3   4   5   6   7   8   9   10   >