[jira] [Commented] (SPARK-6841) Similar to `stats.py` in Python, add support for mean, median, stdev etc.

2015-04-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519843#comment-14519843 ] Shivaram Venkataraman commented on SPARK-6841: -- Yeah I mean it would be good

[jira] [Updated] (SPARK-7226) Support math functions in R DataFrame

2015-04-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7226: - Affects Version/s: 1.4.0 Support math functions in R DataFrame

[jira] [Updated] (SPARK-7227) Support fillna / dropna in R DataFrame

2015-04-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7227: - Priority: Critical (was: Major) Support fillna / dropna in R DataFrame

[jira] [Resolved] (SPARK-6856) Make RDD information more useful in SparkR

2015-04-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6856. -- Resolution: Fixed Fix Version/s: 1.4.0 Fixed by

[jira] [Updated] (SPARK-6991) Adds support for zipPartitions for SparkR

2015-04-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6991: - Assignee: Hao Adds support for zipPartitions for SparkR

[jira] [Resolved] (SPARK-6991) Adds support for zipPartitions for SparkR

2015-04-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6991. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request

[jira] [Created] (SPARK-7264) SparkR API for parallel functions

2015-04-29 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-7264: Summary: SparkR API for parallel functions Key: SPARK-7264 URL: https://issues.apache.org/jira/browse/SPARK-7264 Project: Spark Issue Type:

[jira] [Commented] (SPARK-7230) Make RDD API private in SparkR for Spark 1.4

2015-04-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520465#comment-14520465 ] Shivaram Venkataraman commented on SPARK-7230: -- [~piccolbo] Thanks for your

[jira] [Commented] (SPARK-6810) Performance benchmarks for SparkR

2015-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529873#comment-14529873 ] Shivaram Venkataraman commented on SPARK-6810: -- Moving this to 1.5 as the

[jira] [Updated] (SPARK-6810) Performance benchmarks for SparkR

2015-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6810: - Target Version/s: 1.5.0 (was: 1.4.0) Performance benchmarks for SparkR

[jira] [Updated] (SPARK-6798) Fix Date serialization in SparkR

2015-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6798: - Priority: Minor (was: Major) Fix Date serialization in SparkR

[jira] [Updated] (SPARK-6822) lapplyPartition passes empty list to function

2015-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6822: - Target Version/s: 1.5.0 (was: 1.4.0) lapplyPartition passes empty list to

[jira] [Commented] (SPARK-6837) SparkR failure in processClosure

2015-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529869#comment-14529869 ] Shivaram Venkataraman commented on SPARK-6837: -- Moving this to 1.5 for we

[jira] [Updated] (SPARK-6837) SparkR failure in processClosure

2015-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6837: - Target Version/s: 1.5.0 (was: 1.4.0) SparkR failure in processClosure

[jira] [Assigned] (SPARK-7231) Make SparkR DataFrame API more dplyr friendly

2015-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-7231: Assignee: Shivaram Venkataraman Make SparkR DataFrame API more dplyr

[jira] [Commented] (SPARK-6812) filter() on DataFrame does not work as expected

2015-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529863#comment-14529863 ] Shivaram Venkataraman commented on SPARK-6812: -- Thanks [~sunrui] for

[jira] [Updated] (SPARK-6834) Failed with error: ‘invalid package name’ Error in as.name(name) : attempt to use zero-length variable name

2015-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6834: - Target Version/s: 1.5.0 (was: 1.4.0) Failed with error: ‘invalid package name’

[jira] [Updated] (SPARK-6840) SparkR: private package functions unavailable when using lapplyPartition in package

2015-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6840: - Target Version/s: 1.5.0 (was: 1.4.0) SparkR: private package functions

[jira] [Assigned] (SPARK-6799) Add dataframe examples for SparkR

2015-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-6799: Assignee: Shivaram Venkataraman Add dataframe examples for SparkR

[jira] [Updated] (SPARK-6817) DataFrame UDFs in R

2015-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6817: - Target Version/s: 1.5.0 (was: 1.4.0) DataFrame UDFs in R ---

[jira] [Updated] (SPARK-6812) filter() on DataFrame does not work as expected

2015-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6812: - Assignee: Sun Rui filter() on DataFrame does not work as expected

[jira] [Commented] (SPARK-6812) filter() on DataFrame does not work as expected

2015-05-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529935#comment-14529935 ] Shivaram Venkataraman commented on SPARK-6812: -- Ah I see - We ran into a

[jira] [Updated] (SPARK-7435) Make DataFrame.show() consistent with that of Scala and pySpark

2015-05-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7435: - Target Version/s: 1.4.0 Make DataFrame.show() consistent with that of Scala and

[jira] [Commented] (SPARK-6812) filter() on DataFrame does not work as expected

2015-05-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533491#comment-14533491 ] Shivaram Venkataraman commented on SPARK-6812: -- Yeah lets change them to

[jira] [Commented] (SPARK-7230) Make RDD API private in SparkR for Spark 1.4

2015-05-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532913#comment-14532913 ] Shivaram Venkataraman commented on SPARK-7230: -- Actually with the namespace

[jira] [Commented] (SPARK-6824) Fill the docs for DataFrame API in SparkR

2015-05-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14530855#comment-14530855 ] Shivaram Venkataraman commented on SPARK-6824: -- [~qhuang] A related issue is

[jira] [Updated] (SPARK-6824) Fill the docs for DataFrame API in SparkR

2015-05-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6824: - Assignee: Qian Huang Fill the docs for DataFrame API in SparkR

[jira] [Commented] (SPARK-6812) filter() on DataFrame does not work as expected

2015-05-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14530890#comment-14530890 ] Shivaram Venkataraman commented on SPARK-6812: -- Regarding the name conflicts

[jira] [Resolved] (SPARK-7512) SparkR RDD show method doesn't work after transformations

2015-05-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-7512. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-6824) Fill the docs for DataFrame API in SparkR

2015-05-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6824. -- Resolution: Fixed Fix Version/s: 1.4.0 1.5.0 Issue

[jira] [Commented] (SPARK-7280) Add a method for dropping a column in Java/Scala

2015-05-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536866#comment-14536866 ] Shivaram Venkataraman commented on SPARK-7280: -- FWIW the R API already

[jira] [Commented] (SPARK-7479) SparkR can not work

2015-05-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14535108#comment-14535108 ] Shivaram Venkataraman commented on SPARK-7479: -- Just to add more light - the

[jira] [Created] (SPARK-7512) SparkR RDD show method doesn't work after transformations

2015-05-09 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-7512: Summary: SparkR RDD show method doesn't work after transformations Key: SPARK-7512 URL: https://issues.apache.org/jira/browse/SPARK-7512 Project:

[jira] [Comment Edited] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538449#comment-14538449 ] Shivaram Venkataraman edited comment on SPARK-7520 at 5/11/15 7:02 PM:

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538410#comment-14538410 ] Shivaram Venkataraman commented on SPARK-7520: -- [~shaneknapp] SparkR docs

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538491#comment-14538491 ] Shivaram Venkataraman commented on SPARK-7520: -- The R docs look fine to me

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538449#comment-14538449 ] Shivaram Venkataraman commented on SPARK-7520: -- Can you just use R to resolve

[jira] [Commented] (SPARK-7227) Support fillna / dropna in R DataFrame

2015-05-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539184#comment-14539184 ] Shivaram Venkataraman commented on SPARK-7227: -- [~sunrui] mentioned to me

[jira] [Updated] (SPARK-7227) Support fillna / dropna in R DataFrame

2015-05-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7227: - Assignee: Sun Rui Support fillna / dropna in R DataFrame

[jira] [Updated] (SPARK-7482) Rename some DataFrame API methods in SparkR to match their counterparts in Scala

2015-05-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7482: - Target Version/s: 1.4.0 Rename some DataFrame API methods in SparkR to match

[jira] [Commented] (SPARK-7435) Make DataFrame.show() consistent with that of Scala and pySpark

2015-05-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539192#comment-14539192 ] Shivaram Venkataraman commented on SPARK-7435: -- [~srowen] [~pwendell] Could

[jira] [Resolved] (SPARK-7435) Make DataFrame.show() consistent with that of Scala and pySpark

2015-05-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-7435. -- Resolution: Pending Closed Fix Version/s: 1.4.0 Issue resolved by pull

[jira] [Updated] (SPARK-7482) Rename some DataFrame API methods in SparkR to match their counterparts in Scala

2015-05-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7482: - Assignee: Sun Rui Rename some DataFrame API methods in SparkR to match their

[jira] [Updated] (SPARK-7526) Specify ip of RBackend, MonitorServer and RRDD Socket server

2015-05-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7526: - Assignee: Weizhong Specify ip of RBackend, MonitorServer and RRDD Socket server

[jira] [Updated] (SPARK-7231) Make SparkR DataFrame API more dplyr friendly

2015-05-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7231: - Fix Version/s: 1.4.0 Make SparkR DataFrame API more dplyr friendly

[jira] [Updated] (SPARK-6798) Fix Date serialization in SparkR

2015-05-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6798: - Target Version/s: 1.5.0 (was: 1.4.0) Fix Date serialization in SparkR

[jira] [Resolved] (SPARK-6812) filter() on DataFrame does not work as expected

2015-05-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6812. -- Resolution: Fixed filter() on DataFrame does not work as expected

[jira] [Commented] (SPARK-6812) filter() on DataFrame does not work as expected

2015-05-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532057#comment-14532057 ] Shivaram Venkataraman commented on SPARK-6812: -- Fixed by

[jira] [Created] (SPARK-7499) Investigate how to specify columns in SparkR without $ or strings

2015-05-08 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-7499: Summary: Investigate how to specify columns in SparkR without $ or strings Key: SPARK-7499 URL: https://issues.apache.org/jira/browse/SPARK-7499

[jira] [Commented] (SPARK-7497) test_count_by_value_and_window is flaky

2015-05-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536060#comment-14536060 ] Shivaram Venkataraman commented on SPARK-7497: -- I've seen this a couple of

[jira] [Resolved] (SPARK-7231) Make SparkR DataFrame API more dplyr friendly

2015-05-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-7231. -- Resolution: Fixed Make SparkR DataFrame API more dplyr friendly

[jira] [Commented] (SPARK-7231) Make SparkR DataFrame API more dplyr friendly

2015-05-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14536091#comment-14536091 ] Shivaram Venkataraman commented on SPARK-7231: -- Fixed by

[jira] [Resolved] (SPARK-7228) SparkR public API for 1.4 release

2015-05-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-7228. -- Resolution: Fixed Resolving as all the sub-tasks have been now resolved

[jira] [Commented] (SPARK-7640) Private VPC with default Spark AMI breaks yum

2015-05-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14544111#comment-14544111 ] Shivaram Venkataraman commented on SPARK-7640: -- Unfortunately I've never

[jira] [Commented] (SPARK-7640) Private VPC with default Spark AMI breaks yum

2015-05-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14544072#comment-14544072 ] Shivaram Venkataraman commented on SPARK-7640: -- Does it work if you add

[jira] [Updated] (SPARK-7226) Support math functions in R DataFrame

2015-05-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7226: - Assignee: Qian Huang Support math functions in R DataFrame

[jira] [Commented] (SPARK-6246) spark-ec2 can't handle clusters with 100 nodes

2015-05-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14547501#comment-14547501 ] Shivaram Venkataraman commented on SPARK-6246: -- I just ran into this problem

[jira] [Commented] (SPARK-6819) Support nested types in SparkR DataFrame

2015-05-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14542301#comment-14542301 ] Shivaram Venkataraman commented on SPARK-6819: -- Moving this to 1.5 as this is

[jira] [Updated] (SPARK-6819) Support nested types in SparkR DataFrame

2015-05-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6819: - Target Version/s: 1.5.0 (was: 1.4.0) Support nested types in SparkR DataFrame

[jira] [Resolved] (SPARK-7482) Rename some DataFrame API methods in SparkR to match their counterparts in Scala

2015-05-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-7482. -- Resolution: Fixed Issue resolved by pull request 6007

[jira] [Resolved] (SPARK-7526) Specify ip of RBackend, MonitorServer and RRDD Socket server

2015-05-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-7526. -- Resolution: Fixed Issue resolved by pull request 6053

[jira] [Resolved] (SPARK-7226) Support math functions in R DataFrame

2015-05-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-7226. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request

[jira] [Commented] (SPARK-6820) Convert NAs to null type in SparkR DataFrames

2015-05-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14546174#comment-14546174 ] Shivaram Venkataraman commented on SPARK-6820: -- PR open at

[jira] [Updated] (SPARK-6820) Convert NAs to null type in SparkR DataFrames

2015-05-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6820: - Assignee: Qian Huang Convert NAs to null type in SparkR DataFrames

[jira] [Commented] (SPARK-5256) Improving MLlib optimization APIs

2015-04-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494562#comment-14494562 ] Shivaram Venkataraman commented on SPARK-5256: -- FWIW I also think that API

[jira] [Commented] (SPARK-6831) Document how to use external data sources

2015-04-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496548#comment-14496548 ] Shivaram Venkataraman commented on SPARK-6831: -- I think we should give an

[jira] [Commented] (SPARK-6823) Add a model.matrix like capability to DataFrames (modelDataFrame)

2015-04-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492661#comment-14492661 ] Shivaram Venkataraman commented on SPARK-6823: -- I think the goal of the

[jira] [Resolved] (SPARK-6807) Merge recent changes in SparkR-pkg into Spark

2015-04-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6807. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request

[jira] [Commented] (SPARK-5256) Improving MLlib optimization APIs

2015-04-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494732#comment-14494732 ] Shivaram Venkataraman commented on SPARK-5256: -- Yeah but performance

[jira] [Resolved] (SPARK-6850) SparkR flaky unit tests when run on Jenkins

2015-04-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6850. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request

[jira] [Created] (SPARK-6855) Set R includes in each file to get right collate order

2015-04-10 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-6855: Summary: Set R includes in each file to get right collate order Key: SPARK-6855 URL: https://issues.apache.org/jira/browse/SPARK-6855 Project: Spark

[jira] [Created] (SPARK-6856) Make RDD information more useful in SparkR

2015-04-10 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-6856: Summary: Make RDD information more useful in SparkR Key: SPARK-6856 URL: https://issues.apache.org/jira/browse/SPARK-6856 Project: Spark

[jira] [Updated] (SPARK-6799) Add dataframe examples for SparkR

2015-04-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6799: - Target Version/s: 1.4.0 Add dataframe examples for SparkR

[jira] [Created] (SPARK-6798) Fix Date serialization in SparkR

2015-04-08 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-6798: Summary: Fix Date serialization in SparkR Key: SPARK-6798 URL: https://issues.apache.org/jira/browse/SPARK-6798 Project: Spark Issue Type:

[jira] [Updated] (SPARK-6811) Building binary R packages for SparkR

2015-04-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6811: - Target Version/s: 1.4.0 Building binary R packages for SparkR

[jira] [Resolved] (SPARK-5654) Integrate SparkR into Apache Spark

2015-04-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-5654. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request

[jira] [Created] (SPARK-6811) Building binary R packages for SparkR

2015-04-09 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-6811: Summary: Building binary R packages for SparkR Key: SPARK-6811 URL: https://issues.apache.org/jira/browse/SPARK-6811 Project: Spark Issue

[jira] [Assigned] (SPARK-5654) Integrate SparkR into Apache Spark

2015-04-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-5654: Assignee: Shivaram Venkataraman Integrate SparkR into Apache Spark

[jira] [Created] (SPARK-6816) Add SparkConf API to configure SparkR

2015-04-09 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-6816: Summary: Add SparkConf API to configure SparkR Key: SPARK-6816 URL: https://issues.apache.org/jira/browse/SPARK-6816 Project: Spark Issue

[jira] [Created] (SPARK-6819) Support nested types in SparkR DataFrame

2015-04-09 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-6819: Summary: Support nested types in SparkR DataFrame Key: SPARK-6819 URL: https://issues.apache.org/jira/browse/SPARK-6819 Project: Spark Issue

[jira] [Created] (SPARK-6799) Add dataframe examples for SparkR

2015-04-09 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-6799: Summary: Add dataframe examples for SparkR Key: SPARK-6799 URL: https://issues.apache.org/jira/browse/SPARK-6799 Project: Spark Issue Type:

[jira] [Created] (SPARK-6823) Add a model.matrix like capability to DataFrames (modelDataFrame)

2015-04-09 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-6823: Summary: Add a model.matrix like capability to DataFrames (modelDataFrame) Key: SPARK-6823 URL: https://issues.apache.org/jira/browse/SPARK-6823

[jira] [Created] (SPARK-6822) lapplyPartition passes empty list to function

2015-04-09 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-6822: Summary: lapplyPartition passes empty list to function Key: SPARK-6822 URL: https://issues.apache.org/jira/browse/SPARK-6822 Project: Spark

[jira] [Created] (SPARK-6817) DataFrame UDFs in R

2015-04-09 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-6817: Summary: DataFrame UDFs in R Key: SPARK-6817 URL: https://issues.apache.org/jira/browse/SPARK-6817 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-6821) Refactor SerDe API in SparkR to be more developer friendly

2015-04-09 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-6821: Summary: Refactor SerDe API in SparkR to be more developer friendly Key: SPARK-6821 URL: https://issues.apache.org/jira/browse/SPARK-6821 Project:

[jira] [Created] (SPARK-6813) SparkR style guide

2015-04-09 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-6813: Summary: SparkR style guide Key: SPARK-6813 URL: https://issues.apache.org/jira/browse/SPARK-6813 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-6803) Support SparkR Streaming

2015-04-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487800#comment-14487800 ] Shivaram Venkataraman commented on SPARK-6803: -- Thanks [~hlin09]. The PySpark

[jira] [Created] (SPARK-6810) Performance benchmarks for SparkR

2015-04-09 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-6810: Summary: Performance benchmarks for SparkR Key: SPARK-6810 URL: https://issues.apache.org/jira/browse/SPARK-6810 Project: Spark Issue Type:

[jira] [Created] (SPARK-6820) Convert NAs to null type in SparkR DataFrames

2015-04-09 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-6820: Summary: Convert NAs to null type in SparkR DataFrames Key: SPARK-6820 URL: https://issues.apache.org/jira/browse/SPARK-6820 Project: Spark

[jira] [Commented] (SPARK-6816) Add SparkConf API to configure SparkR

2015-04-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14488237#comment-14488237 ] Shivaram Venkataraman commented on SPARK-6816: -- Comments from SparkR JIRA

[jira] [Commented] (SPARK-6704) integrate SparkR docs build tool into Spark doc build

2015-04-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14486766#comment-14486766 ] Shivaram Venkataraman commented on SPARK-6704: -- This was actually fixed in

[jira] [Resolved] (SPARK-6704) integrate SparkR docs build tool into Spark doc build

2015-04-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6704. -- Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Shivaram

[jira] [Created] (SPARK-6814) Support sorting for any data type in SparkR

2015-04-09 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-6814: Summary: Support sorting for any data type in SparkR Key: SPARK-6814 URL: https://issues.apache.org/jira/browse/SPARK-6814 Project: Spark

[jira] [Created] (SPARK-6797) Add support for YARN cluster mode

2015-04-08 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-6797: Summary: Add support for YARN cluster mode Key: SPARK-6797 URL: https://issues.apache.org/jira/browse/SPARK-6797 Project: Spark Issue Type:

[jira] [Commented] (SPARK-6812) filter() on DataFrame does not work as expected

2015-04-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14488128#comment-14488128 ] Shivaram Venkataraman commented on SPARK-6812: -- Hmm - don't we have a unit

[jira] [Resolved] (SPARK-6246) spark-ec2 can't handle clusters with 100 nodes

2015-05-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6246. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Commented] (SPARK-6246) spark-ec2 can't handle clusters with 100 nodes

2015-05-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14551486#comment-14551486 ] Shivaram Venkataraman commented on SPARK-6246: -- [~srowen] Could you add

[jira] [Created] (SPARK-8085) Pass in user-specified schema in read.df

2015-06-03 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-8085: Summary: Pass in user-specified schema in read.df Key: SPARK-8085 URL: https://issues.apache.org/jira/browse/SPARK-8085 Project: Spark Issue

[jira] [Updated] (SPARK-8063) Spark master URL conflict between MASTER env variable and --master command line option

2015-06-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8063: - Assignee: Sun Rui Spark master URL conflict between MASTER env variable and

[jira] [Created] (SPARK-8084) SparkR install script should fail with error if any packages required are not found

2015-06-03 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-8084: Summary: SparkR install script should fail with error if any packages required are not found Key: SPARK-8084 URL: https://issues.apache.org/jira/browse/SPARK-8084

<    1   2   3   4   5   6   7   8   9   10   >