[jira] [Resolved] (SPARK-8063) Spark master URL conflict between MASTER env variable and --master command line option

2015-06-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8063. -- Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Issue

[jira] [Updated] (SPARK-8111) SparkR shell should display Spark logo and version banner on startup

2015-06-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8111: - Labels: Starter (was: ) SparkR shell should display Spark logo and version

[jira] [Commented] (SPARK-8111) SparkR shell should display Spark logo and version banner on startup

2015-06-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573574#comment-14573574 ] Shivaram Venkataraman commented on SPARK-8111: -- The code will need to go in

[jira] [Resolved] (SPARK-6820) Convert NAs to null type in SparkR DataFrames

2015-06-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6820. -- Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Issue

[jira] [Resolved] (SPARK-8085) Pass in user-specified schema in read.df

2015-06-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8085. -- Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Issue

[jira] [Created] (SPARK-8137) Improve treeAggregate to combine all data on one machine first

2015-06-05 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-8137: Summary: Improve treeAggregate to combine all data on one machine first Key: SPARK-8137 URL: https://issues.apache.org/jira/browse/SPARK-8137

[jira] [Created] (SPARK-8277) SparkR createDataFrame is slow

2015-06-09 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-8277: Summary: SparkR createDataFrame is slow Key: SPARK-8277 URL: https://issues.apache.org/jira/browse/SPARK-8277 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2774) Set preferred locations for reduce tasks

2015-06-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572302#comment-14572302 ] Shivaram Venkataraman commented on SPARK-2774: -- [~rxin] [~joshrosen] is there

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596256#comment-14596256 ] Shivaram Venkataraman commented on SPARK-6813: -- Thats great to know. Thanks

[jira] [Commented] (SPARK-8409) In windows cant able to read .csv or .json files using read.df()

2015-06-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596130#comment-14596130 ] Shivaram Venkataraman commented on SPARK-8409: -- Couple of points 1. The

[jira] [Commented] (SPARK-7499) Investigate how to specify columns in SparkR without $ or strings

2015-06-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596206#comment-14596206 ] Shivaram Venkataraman commented on SPARK-7499: -- Actually we can construct a

[jira] [Commented] (SPARK-8429) Add ability to set additional tags

2015-06-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596411#comment-14596411 ] Shivaram Venkataraman commented on SPARK-8429: -- [~srowen] Could you add

[jira] [Updated] (SPARK-8537) Add a validation rule about the curly braces in SparkR to `.lintr`

2015-06-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8537: - Assignee: Yu Ishikawa Add a validation rule about the curly braces in SparkR to

[jira] [Resolved] (SPARK-8537) Add a validation rule about the curly braces in SparkR to `.lintr`

2015-06-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8537. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596645#comment-14596645 ] Shivaram Venkataraman commented on SPARK-6813: -- Yeah lets do that and then

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596678#comment-14596678 ] Shivaram Venkataraman commented on SPARK-6813: -- I think we can start fixing

[jira] [Resolved] (SPARK-8452) expose jobGroup API in SparkR

2015-06-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8452. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-8452) expose jobGroup API in SparkR

2015-06-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8452: - Assignee: Hossein Falaki expose jobGroup API in SparkR

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14595150#comment-14595150 ] Shivaram Venkataraman commented on SPARK-6813: -- Yeah we could disable those

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594239#comment-14594239 ] Shivaram Venkataraman commented on SPARK-6813: -- Two things 1. For the

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594263#comment-14594263 ] Shivaram Venkataraman commented on SPARK-6813: -- The list looks good to me.

[jira] [Commented] (SPARK-7499) Investigate how to specify columns in SparkR without $ or strings

2015-06-21 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14595153#comment-14595153 ] Shivaram Venkataraman commented on SPARK-7499: -- [~sd2k] Thanks for taking a

[jira] [Commented] (SPARK-8603) In Windows,Not able to create a Spark context from R studio

2015-06-25 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601496#comment-14601496 ] Shivaram Venkataraman commented on SPARK-8603: -- So a few points about the

[jira] [Created] (SPARK-8637) Packages argument is wrong in sparkR.init

2015-06-25 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-8637: Summary: Packages argument is wrong in sparkR.init Key: SPARK-8637 URL: https://issues.apache.org/jira/browse/SPARK-8637 Project: Spark

[jira] [Commented] (SPARK-8603) In Windows,Not able to create a Spark context from R studio

2015-06-24 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14600154#comment-14600154 ] Shivaram Venkataraman commented on SPARK-8603: -- Could you add some details on

[jira] [Created] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-24 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-8596: Summary: Install and configure RStudio server on Spark EC2 Key: SPARK-8596 URL: https://issues.apache.org/jira/browse/SPARK-8596 Project: Spark

[jira] [Commented] (SPARK-8409) In windows cant able to read .csv or .json files using read.df()

2015-06-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14592059#comment-14592059 ] Shivaram Venkataraman commented on SPARK-8409: -- As you can see in the error

[jira] [Commented] (SPARK-6817) DataFrame UDFs in R

2015-06-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14592087#comment-14592087 ] Shivaram Venkataraman commented on SPARK-6817: -- I think there are two

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14592060#comment-14592060 ] Shivaram Venkataraman commented on SPARK-6813: -- Yeah we don't need to merge

[jira] [Commented] (SPARK-8431) Add in operator to DataFrame Column in SparkR

2015-06-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14592069#comment-14592069 ] Shivaram Venkataraman commented on SPARK-8431: -- [~yuu.ishik...@gmail.com]

[jira] [Commented] (SPARK-8409) In windows cant able to read .csv or .json files using read.df()

2015-06-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14592037#comment-14592037 ] Shivaram Venkataraman commented on SPARK-8409: -- Couple of points 1. Yes, one

[jira] [Commented] (SPARK-8348) Add in operator to DataFrame Column

2015-06-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14592043#comment-14592043 ] Shivaram Venkataraman commented on SPARK-8348: -- [~yuu.ishik...@gmail.com]

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593584#comment-14593584 ] Shivaram Venkataraman commented on SPARK-6813: -- [~yuu.ishik...@gmail.com]

[jira] [Commented] (SPARK-8431) Add in operator to DataFrame Column in SparkR

2015-06-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593612#comment-14593612 ] Shivaram Venkataraman commented on SPARK-8431: -- Hmm I am not sure we need a

[jira] [Resolved] (SPARK-8429) Add ability to set additional tags

2015-06-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8429. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-8482) Add M4 instances support

2015-06-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8482. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-8482) Add M4 instances support

2015-06-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8482: - Assignee: Pradeep Chhetri Add M4 instances support

[jira] [Resolved] (SPARK-8548) Remove the trailing whitespaces from the SparkR files

2015-06-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8548. -- Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Issue

[jira] [Updated] (SPARK-8548) Remove the trailing whitespaces from the SparkR files

2015-06-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8548: - Assignee: Yu Ishikawa Remove the trailing whitespaces from the SparkR files

[jira] [Commented] (SPARK-8409) In windows cant able to read .csv or .json files using read.df()

2015-06-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603094#comment-14603094 ] Shivaram Venkataraman commented on SPARK-8409: -- If you open those links it

[jira] [Commented] (SPARK-8409) In windows cant able to read .csv or .json files using read.df()

2015-06-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603030#comment-14603030 ] Shivaram Venkataraman commented on SPARK-8409: -- I don't see your email in the

[jira] [Resolved] (SPARK-8409) In windows cant able to read .csv or .json files using read.df()

2015-06-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8409. -- Resolution: Not A Problem In windows cant able to read .csv or .json files

[jira] [Resolved] (SPARK-8662) [SparkR] SparkSQL tests fail in R 3.2

2015-06-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8662. -- Resolution: Fixed Fix Version/s: 1.4.2 1.5.0

[jira] [Commented] (SPARK-8662) [SparkR] SparkSQL tests fail in R 3.2

2015-06-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603213#comment-14603213 ] Shivaram Venkataraman commented on SPARK-8662: -- Resolved by

[jira] [Commented] (SPARK-8662) [SparkR] SparkSQL tests fail in R 3.2

2015-06-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603214#comment-14603214 ] Shivaram Venkataraman commented on SPARK-8662: -- [~srowen] Could you help add

[jira] [Updated] (SPARK-8662) [SparkR] SparkSQL tests fail in R 3.2

2015-06-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8662: - Fix Version/s: (was: 1.4.0) [SparkR] SparkSQL tests fail in R 3.2

[jira] [Commented] (SPARK-8637) Packages argument is wrong in sparkR.init

2015-06-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603116#comment-14603116 ] Shivaram Venkataraman commented on SPARK-8637: -- Thanks [~amar.h...@gmail.com]

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604307#comment-14604307 ] Shivaram Venkataraman commented on SPARK-8596: -- [~cantdutchthis] Thanks for

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593655#comment-14593655 ] Shivaram Venkataraman commented on SPARK-6813: -- FWIW I think the basic things

[jira] [Resolved] (SPARK-8495) Add a `.lintr` file to validate the SparkR files and the `lint-r` script

2015-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8495. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Commented] (SPARK-8506) SparkR does not provide an easy way to depend on Spark Packages when performing init from inside of R

2015-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594870#comment-14594870 ] Shivaram Venkataraman commented on SPARK-8506: -- Yeah sounds good to me. One

[jira] [Updated] (SPARK-8495) Add a `.lintr` file to validate the SparkR files and the `lint-r` script

2015-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8495: - Assignee: Yu Ishikawa Add a `.lintr` file to validate the SparkR files and the

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594873#comment-14594873 ] Shivaram Venkataraman commented on SPARK-6813: -- In terms of fixing the style

[jira] [Commented] (SPARK-8506) SparkR does not provide an easy way to depend on Spark Packages when performing init from inside of R

2015-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594854#comment-14594854 ] Shivaram Venkataraman commented on SPARK-8506: -- Thats a good point - I just

[jira] [Resolved] (SPARK-8576) Add spark-ec2 options to assign launched instances into IAM roles and to set instance-initiated shutdown behavior

2015-06-24 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8576. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Commented] (SPARK-8111) SparkR shell should display Spark logo and version banner on startup

2015-06-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598515#comment-14598515 ] Shivaram Venkataraman commented on SPARK-8111: -- Issue resolved by

[jira] [Resolved] (SPARK-8111) SparkR shell should display Spark logo and version banner on startup

2015-06-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8111. -- Resolution: Fixed SparkR shell should display Spark logo and version banner on

[jira] [Updated] (SPARK-8506) SparkR does not provide an easy way to depend on Spark Packages when performing init from inside of R

2015-06-24 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8506: - Assignee: holdenk SparkR does not provide an easy way to depend on Spark

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-06-24 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14599940#comment-14599940 ] Shivaram Venkataraman commented on SPARK-8596: -- I think it should technically

[jira] [Resolved] (SPARK-8506) SparkR does not provide an easy way to depend on Spark Packages when performing init from inside of R

2015-06-24 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8506. -- Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Issue

[jira] [Commented] (SPARK-8662) [SparkR] SparkSQL tests fail in R 3.2

2015-06-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603437#comment-14603437 ] Shivaram Venkataraman commented on SPARK-8662: -- Thanks [~srowen] ! I was able

[jira] [Updated] (SPARK-8662) [SparkR] SparkSQL tests fail in R 3.2

2015-06-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8662: - Assignee: Chris Freeman [SparkR] SparkSQL tests fail in R 3.2

[jira] [Resolved] (SPARK-8607) SparkR - Third party jars are not being added to classpath in SparkRBackend

2015-06-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8607. -- Resolution: Fixed Fix Version/s: (was: 1.4.0)

[jira] [Updated] (SPARK-8607) SparkR - Third party jars are not being added to classpath in SparkRBackend

2015-06-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8607: - Assignee: Chris Freeman SparkR - Third party jars are not being added to

[jira] [Created] (SPARK-8311) saveAsTextFile with Hadoop1 could lead to errors

2015-06-11 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-8311: Summary: saveAsTextFile with Hadoop1 could lead to errors Key: SPARK-8311 URL: https://issues.apache.org/jira/browse/SPARK-8311 Project: Spark

[jira] [Resolved] (SPARK-8310) Spark EC2 branch in 1.4 is wrong

2015-06-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8310. -- Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Issue

[jira] [Commented] (SPARK-8380) SparkR mis-counts

2015-06-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588196#comment-14588196 ] Shivaram Venkataraman commented on SPARK-8380: -- Thanks for the update. I'm

[jira] [Resolved] (SPARK-8350) R unit tests output should be logged to unit-tests.log

2015-06-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8350. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Commented] (SPARK-8311) saveAsTextFile with Hadoop1 could lead to errors

2015-06-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582977#comment-14582977 ] Shivaram Venkataraman commented on SPARK-8311: -- Yeah it looks very similar.

[jira] [Commented] (SPARK-8340) Error creating sparkR dataframe: Error in writeJobj(ocn, object): invalid jobj 2

2015-06-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584897#comment-14584897 ] Shivaram Venkataraman commented on SPARK-8340: -- Thanks [~nevi_me] for the

[jira] [Resolved] (SPARK-8340) Error creating sparkR dataframe: Error in writeJobj(ocn, object): invalid jobj 2

2015-06-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8340. -- Resolution: Not A Problem Error creating sparkR dataframe: Error in

[jira] [Commented] (SPARK-8340) Error creating sparkR dataframe: Error in writeJobj(ocn, object): invalid jobj 2

2015-06-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584616#comment-14584616 ] Shivaram Venkataraman commented on SPARK-8340: -- It looks like there must have

[jira] [Updated] (SPARK-5971) Add Mesos support to spark-ec2

2015-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-5971: - Target Version/s: 1.5.0 (was: 1.4.0) Add Mesos support to spark-ec2

[jira] [Commented] (SPARK-6218) Upgrade spark-ec2 from optparse to argparse

2015-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590791#comment-14590791 ] Shivaram Venkataraman commented on SPARK-6218: -- [~nchammas] I just updated

[jira] [Commented] (SPARK-5971) Add Mesos support to spark-ec2

2015-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590799#comment-14590799 ] Shivaram Venkataraman commented on SPARK-5971: -- Moving this to target 1.5.0

[jira] [Updated] (SPARK-6218) Upgrade spark-ec2 from optparse to argparse

2015-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6218: - Target Version/s: 1.5.0 (was: 1.4.0) Upgrade spark-ec2 from optparse to

[jira] [Updated] (SPARK-8409) In windows cant able to read .csv or .json files using read.df()

2015-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8409: - Summary: In windows cant able to read .csv or .json files using read.df() (was:

[jira] [Commented] (SPARK-8409) In windows cant able to read .csv or .json files using read.df()

2015-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589906#comment-14589906 ] Shivaram Venkataraman commented on SPARK-8409: -- The error here is that the

[jira] [Commented] (SPARK-8409) In windows cant able to read .csv or .json files using read.df()

2015-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590116#comment-14590116 ] Shivaram Venkataraman commented on SPARK-8409: -- [~b.arunguna...@gmail.com]

[jira] [Resolved] (SPARK-8409) In windows cant able to read .csv or .json files using read.df()

2015-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8409. -- Resolution: Not A Problem In windows cant able to read .csv or .json files

[jira] [Commented] (SPARK-8380) SparkR mis-counts

2015-06-15 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586277#comment-14586277 ] Shivaram Venkataraman commented on SPARK-8380: -- [~RPCMoritz] Couple of things

[jira] [Commented] (SPARK-8311) saveAsTextFile with Hadoop1 could lead to errors

2015-06-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583561#comment-14583561 ] Shivaram Venkataraman commented on SPARK-8311: -- [~lian cheng] I was using

[jira] [Resolved] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8322. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Commented] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14583559#comment-14583559 ] Shivaram Venkataraman commented on SPARK-8322: -- [~srowen] Could you assign

[jira] [Commented] (SPARK-6797) Add support for YARN cluster mode

2015-06-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570307#comment-14570307 ] Shivaram Venkataraman commented on SPARK-6797: -- You are right that we are

[jira] [Commented] (SPARK-7909) spark-ec2 and associated tools not py3 ready

2015-05-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563634#comment-14563634 ] Shivaram Venkataraman commented on SPARK-7909: -- Yeah I think that error comes

[jira] [Commented] (SPARK-7230) Make RDD API private in SparkR for Spark 1.4

2015-05-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563593#comment-14563593 ] Shivaram Venkataraman commented on SPARK-7230: -- [~cantdutchthis] Thanks both

[jira] [Commented] (SPARK-7909) spark-ec2 and associated tools not py3 ready

2015-05-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563581#comment-14563581 ] Shivaram Venkataraman commented on SPARK-7909: -- You can find the 1.4 RC2

[jira] [Commented] (SPARK-7909) spark-ec2 and associated tools not py3 ready

2015-05-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564168#comment-14564168 ] Shivaram Venkataraman commented on SPARK-7909: -- The packages will get to S3

[jira] [Updated] (SPARK-6820) Convert NAs to null type in SparkR DataFrames

2015-05-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6820: - Target Version/s: 1.4.1 (was: 1.4.0) Convert NAs to null type in SparkR

[jira] [Resolved] (SPARK-7227) Support fillna / dropna in R DataFrame

2015-05-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-7227. -- Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Issue

[jira] [Commented] (SPARK-7909) spark-ec2 and associated tools not py3 ready

2015-06-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567735#comment-14567735 ] Shivaram Venkataraman commented on SPARK-7909: -- Yeah feel free to open a PR

[jira] [Commented] (SPARK-6816) Add SparkConf API to configure SparkR

2015-06-01 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568150#comment-14568150 ] Shivaram Venkataraman commented on SPARK-6816: -- [~RPCMoritz] Have you tried

[jira] [Commented] (SPARK-7806) spark-ec2 launch script fails for Python3

2015-05-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14561390#comment-14561390 ] Shivaram Venkataraman commented on SPARK-7806: -- Merged

[jira] [Resolved] (SPARK-7806) spark-ec2 launch script fails for Python3

2015-05-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-7806. -- Resolution: Fixed Fix Version/s: 1.4.0 [~srowen] Could you add

[jira] [Commented] (SPARK-7806) spark-ec2 launch script fails for Python3

2015-05-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14561677#comment-14561677 ] Shivaram Venkataraman commented on SPARK-7806: -- [~meawoppl] Lets open new

[jira] [Commented] (SPARK-7909) spark-ec2 and associated tools not py3 ready

2015-05-27 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562161#comment-14562161 ] Shivaram Venkataraman commented on SPARK-7909: -- Could you check the worker

[jira] [Commented] (SPARK-7900) Reduce number of tagging calls in spark-ec2

2015-05-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563202#comment-14563202 ] Shivaram Venkataraman commented on SPARK-7900: -- I am not sure how we can

[jira] [Commented] (SPARK-6797) Add support for YARN cluster mode

2015-06-02 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569432#comment-14569432 ] Shivaram Venkataraman commented on SPARK-6797: -- Yeah I don't think we can

[jira] [Commented] (SPARK-7900) Reduce number of tagging calls in spark-ec2

2015-05-28 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563225#comment-14563225 ] Shivaram Venkataraman commented on SPARK-7900: -- I personally don't mind all

<    1   2   3   4   5   6   7   8   9   10   >