[jira] [Resolved] (SPARK-11258) Converting a Spark DataFrame into an R data.frame is slow / requires a lot of memory

[ https://issues.apache.org/jira/browse/SPARK-11258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11258. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975715#comment-14975715 ] Shivaram Venkataraman commented on SPARK-11255: --- Yeah I think the point about having 3.1.1

[jira] [Resolved] (SPARK-11209) Add window functions into SparkR [step 1]

[ https://issues.apache.org/jira/browse/SPARK-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11209. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 1.6.0

[jira] [Commented] (SPARK-11407) Add documentation on using SparkR from RStudio

[ https://issues.apache.org/jira/browse/SPARK-11407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981427#comment-14981427 ] Shivaram Venkataraman commented on SPARK-11407: --- Yeah - the two things listed above seem

[jira] [Updated] (SPARK-11294) Improve R doc for read.df, write.df, saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-11294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11294: -- Assignee: Felix Cheung > Improve R doc for read.df, write.df, saveAsTable >

[jira] [Resolved] (SPARK-11294) Improve R doc for read.df, write.df, saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-11294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11294. --- Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue

[jira] [Resolved] (SPARK-10971) sparkR: RRunner should allow setting path to Rscript

[ https://issues.apache.org/jira/browse/SPARK-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10971. --- Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue

[jira] [Commented] (SPARK-10971) sparkR: RRunner should allow setting path to Rscript

[ https://issues.apache.org/jira/browse/SPARK-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972377#comment-14972377 ] Shivaram Venkataraman commented on SPARK-10971: --- [~pwendell] I see a commit for cutting

[jira] [Updated] (SPARK-10971) sparkR: RRunner should allow setting path to Rscript

[ https://issues.apache.org/jira/browse/SPARK-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10971: -- Assignee: Sun Rui > sparkR: RRunner should allow setting path to Rscript >

[jira] [Commented] (SPARK-11283) List column gets additional level of nesting when converted to Spark DataFrame

[ https://issues.apache.org/jira/browse/SPARK-11283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974507#comment-14974507 ] Shivaram Venkataraman commented on SPARK-11283: --- cc [~sunrui] > List column gets

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967907#comment-14967907 ] Shivaram Venkataraman commented on SPARK-11190: --- You'll need to add the -Psparkr flag as

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968085#comment-14968085 ] Shivaram Venkataraman commented on SPARK-11190: --- Environments can be used like a hash map

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968031#comment-14968031 ] Shivaram Venkataraman commented on SPARK-11190: --- We do convert maps in Scala to

[jira] [Resolved] (SPARK-11244) sparkR.stop doesn't clean up .sparkRSQLsc in environment

[ https://issues.apache.org/jira/browse/SPARK-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11244. --- Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue

[jira] [Updated] (SPARK-11244) sparkR.stop doesn't clean up .sparkRSQLsc in environment

[ https://issues.apache.org/jira/browse/SPARK-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11244: -- Assignee: Sen Fang > sparkR.stop doesn't clean up .sparkRSQLsc in environment

[jira] [Resolved] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10863. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10863: -- Assignee: Oscar D. Lara Yejas > Method coltypes() to return the R column types

[jira] [Resolved] (SPARK-11587) SparkR can not use summary.glm from base R

[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11587. --- Resolution: Fixed Fix Version/s: 1.6.0 Resolved by

[jira] [Assigned] (SPARK-11587) SparkR can not use summary.glm from base R

[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-11587: - Assignee: Shivaram Venkataraman > SparkR can not use summary.glm from

[jira] [Commented] (SPARK-11587) SparkR can not use summary.glm from base R

[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997967#comment-14997967 ] Shivaram Venkataraman commented on SPARK-11587: --- [~yanboliang] Let me know if the fix works

[jira] [Updated] (SPARK-9865) Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

[ https://issues.apache.org/jira/browse/SPARK-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9865: - Assignee: Felix Cheung > Flaky SparkR test: test_sparkSQL.R: sample on a

[jira] [Resolved] (SPARK-9865) Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

[ https://issues.apache.org/jira/browse/SPARK-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9865. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-11587) SparkR can not use summary.glm from base R

[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997035#comment-14997035 ] Shivaram Venkataraman commented on SPARK-11587: --- cc [~sunrui] We should fix this - We have

[jira] [Updated] (SPARK-11587) SparkR can not use summary.glm from base R

[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11587: -- Component/s: SparkR > SparkR can not use summary.glm from base R >

[jira] [Updated] (SPARK-11263) lintr Throws Warnings on Commented Code in Documentation

[ https://issues.apache.org/jira/browse/SPARK-11263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11263: -- Assignee: Felix Cheung > lintr Throws Warnings on Commented Code in

[jira] [Resolved] (SPARK-11717) Ignore R session and history files from git

[ https://issues.apache.org/jira/browse/SPARK-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11717. --- Resolution: Fixed Assignee: Kai Sasaki Fix Version/s: 1.7.0

[jira] [Commented] (SPARK-11281) Issue with creating and collecting DataFrame using environments

[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006966#comment-15006966 ] Shivaram Venkataraman commented on SPARK-11281: --- Does the example posted in the description

[jira] [Commented] (SPARK-11281) Issue with creating and collecting DataFrame using environments

[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006955#comment-15006955 ] Shivaram Venkataraman commented on SPARK-11281: --- [~sunrui] [~zero323] Is there a test case

[jira] [Reopened] (SPARK-11281) Issue with creating and collecting DataFrame using environments

[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reopened SPARK-11281: --- Assignee: (was: Maciej Szymkiewicz) > Issue with creating and

[jira] [Commented] (SPARK-11281) Issue with creating and collecting DataFrame using environments

[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007064#comment-15007064 ] Shivaram Venkataraman commented on SPARK-11281: --- Thats cool ! lets keep this open till we

[jira] [Reopened] (SPARK-9603) Re-enable complex R package test in SparkSubmitSuite

[ https://issues.apache.org/jira/browse/SPARK-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reopened SPARK-9603: -- We still have some failures on Jenkins as reported in

[jira] [Resolved] (SPARK-8277) SparkR createDataFrame is slow

[ https://issues.apache.org/jira/browse/SPARK-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8277. -- Resolution: Fixed Assignee: Maciej Szymkiewicz Fix Version/s:

[jira] [Resolved] (SPARK-11086) createDataFrame should dropFactor column-wise not cell-wise

[ https://issues.apache.org/jira/browse/SPARK-11086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11086. --- Resolution: Fixed Assignee: Maciej Szymkiewicz Fix Version/s:

[jira] [Resolved] (SPARK-10500) sparkr.zip cannot be created if $SPARK_HOME/R/lib is unwritable

[ https://issues.apache.org/jira/browse/SPARK-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10500. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-10500) sparkr.zip cannot be created if $SPARK_HOME/R/lib is unwritable

[ https://issues.apache.org/jira/browse/SPARK-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10500: -- Assignee: Sun Rui > sparkr.zip cannot be created if $SPARK_HOME/R/lib is

[jira] [Commented] (SPARK-11668) R style summary stats in GLM package SparkR

[ https://issues.apache.org/jira/browse/SPARK-11668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15001124#comment-15001124 ] Shivaram Venkataraman commented on SPARK-11668: --- I think this is already covered in

[jira] [Commented] (SPARK-11339) Document the list of functions in R base package that are masked by functions with same name in SparkR

[ https://issues.apache.org/jira/browse/SPARK-11339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997929#comment-14997929 ] Shivaram Venkataraman commented on SPARK-11339: --- Thanks [~felixcheung] -- This list looks

[jira] [Commented] (SPARK-11587) SparkR can not use summary.glm from base R

[ https://issues.apache.org/jira/browse/SPARK-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997748#comment-14997748 ] Shivaram Venkataraman commented on SPARK-11587: --- I found the problem. Working on a PR >

[jira] [Resolved] (SPARK-11409) Enable url link in R doc for Persist

[ https://issues.apache.org/jira/browse/SPARK-11409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11409. --- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 1.6.0

[jira] [Updated] (SPARK-11340) Support setting driver properties when starting Spark from R programmatically or from RStudio

[ https://issues.apache.org/jira/browse/SPARK-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11340: -- Assignee: Felix Cheung > Support setting driver properties when starting Spark

[jira] [Resolved] (SPARK-11340) Support setting driver properties when starting Spark from R programmatically or from RStudio

[ https://issues.apache.org/jira/browse/SPARK-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11340. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-11340) Support setting driver properties when starting Spark from R programmatically or from RStudio

[ https://issues.apache.org/jira/browse/SPARK-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983294#comment-14983294 ] Shivaram Venkataraman commented on SPARK-11340: --- [~felixcheung][~sunrui] It'll be great if

[jira] [Updated] (SPARK-6834) Failed with error: ‘invalid package name’ Error in as.name(name) : attempt to use zero-length variable name

[ https://issues.apache.org/jira/browse/SPARK-6834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6834: - Target Version/s: (was: 1.6.0) > Failed with error: ‘invalid package name’

[jira] [Updated] (SPARK-6837) SparkR failure in processClosure

[ https://issues.apache.org/jira/browse/SPARK-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6837: - Target Version/s: (was: 1.6.0) > SparkR failure in processClosure >

[jira] [Resolved] (SPARK-11407) Add documentation on using SparkR from RStudio

[ https://issues.apache.org/jira/browse/SPARK-11407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11407. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-11263) lintr Throws Warnings on Commented Code in Documentation

[ https://issues.apache.org/jira/browse/SPARK-11263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988023#comment-14988023 ] Shivaram Venkataraman commented on SPARK-11263: --- I think the thing I'd like to try is to

[jira] [Updated] (SPARK-6840) SparkR: private package functions unavailable when using lapplyPartition in package

[ https://issues.apache.org/jira/browse/SPARK-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6840: - Target Version/s: (was: 1.6.0) > SparkR: private package functions unavailable

[jira] [Updated] (SPARK-11407) Add documentation on using SparkR from RStudio

[ https://issues.apache.org/jira/browse/SPARK-11407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11407: -- Assignee: Felix Cheung > Add documentation on using SparkR from RStudio >

[jira] [Updated] (SPARK-11260) Add 'with' API

[ https://issues.apache.org/jira/browse/SPARK-11260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11260: -- Assignee: Weiqiang Zhuang > Add 'with' API > -- > >

[jira] [Resolved] (SPARK-11260) Add 'with' API

[ https://issues.apache.org/jira/browse/SPARK-11260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11260. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-11414) Forgot to update usage of "spark.sparkr.r.command" in RRDD in the PR for SPARK-10971

[ https://issues.apache.org/jira/browse/SPARK-11414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11414: -- Assignee: Sun Rui > Forgot to update usage of "spark.sparkr.r.command" in RRDD

[jira] [Updated] (SPARK-11210) Add window functions into SparkR [step 2]

[ https://issues.apache.org/jira/browse/SPARK-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11210: -- Assignee: Sun Rui > Add window functions into SparkR [step 2] >

[jira] [Resolved] (SPARK-11414) Forgot to update usage of "spark.sparkr.r.command" in RRDD in the PR for SPARK-10971

[ https://issues.apache.org/jira/browse/SPARK-11414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11414. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-11210) Add window functions into SparkR [step 2]

[ https://issues.apache.org/jira/browse/SPARK-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11210. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-6819) Support nested types in SparkR DataFrame

[ https://issues.apache.org/jira/browse/SPARK-6819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6819. -- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 1.6.0 >

[jira] [Updated] (SPARK-6817) DataFrame UDFs in R

[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6817: - Target Version/s: (was: 1.6.0) > DataFrame UDFs in R > --- > >

[jira] [Updated] (SPARK-10981) R semijoin leads to Java errors, R leftsemi leads to Spark errors

[ https://issues.apache.org/jira/browse/SPARK-10981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10981: -- Assignee: Monica Liu > R semijoin leads to Java errors, R leftsemi leads to

[jira] [Resolved] (SPARK-10981) R semijoin leads to Java errors, R leftsemi leads to Spark errors

[ https://issues.apache.org/jira/browse/SPARK-10981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10981. --- Resolution: Fixed Fix Version/s: 1.6.0 1.5.2

[jira] [Resolved] (SPARK-10996) Implement sampleBy() in DataFrameStatFunctions

[ https://issues.apache.org/jira/browse/SPARK-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10996. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 1.6.0

[jira] [Resolved] (SPARK-10836) SparkR: Add sort function to dataframe

[ https://issues.apache.org/jira/browse/SPARK-10836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10836. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-10836) SparkR: Add sort function to dataframe

[ https://issues.apache.org/jira/browse/SPARK-10836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10836: -- Assignee: Narine Kokhlikyan > SparkR: Add sort function to dataframe >

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964032#comment-14964032 ] Shivaram Venkataraman commented on SPARK-11190: --- cc [~sunrui] Could you try this on the

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965327#comment-14965327 ] Shivaram Venkataraman commented on SPARK-11190: --- The changes I mentioned are not in 1.5.2.

[jira] [Resolved] (SPARK-11221) Fix R doc for DataFrame function `lit`

[ https://issues.apache.org/jira/browse/SPARK-11221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11221. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-11221) Fix R doc for DataFrame function `lit`

[ https://issues.apache.org/jira/browse/SPARK-11221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11221: -- Assignee: Felix Cheung > Fix R doc for DataFrame function `lit` >

[jira] [Commented] (SPARK-10683) Source code missing for SparkR test JAR

[ https://issues.apache.org/jira/browse/SPARK-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952360#comment-14952360 ] Shivaram Venkataraman commented on SPARK-10683: --- Yeah - the JAR has no impact on Spark

[jira] [Updated] (SPARK-10683) Source code missing for SparkR test JAR

[ https://issues.apache.org/jira/browse/SPARK-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10683: -- Component/s: SparkR > Source code missing for SparkR test JAR >

[jira] [Commented] (SPARK-11057) SparkSQL: corr and cov for many columns

[ https://issues.apache.org/jira/browse/SPARK-11057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952432#comment-14952432 ] Shivaram Venkataraman commented on SPARK-11057: --- [~Narine] Does this feature exist in Scala

[jira] [Commented] (SPARK-9443) Expose sampleByKey in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945816#comment-14945816 ] Shivaram Venkataraman commented on SPARK-9443: -- Yes. I think so > Expose sampleByKey in

[jira] [Resolved] (SPARK-10079) Make `column` and `col` functions be S4 functions

[ https://issues.apache.org/jira/browse/SPARK-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10079. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-10079) Make `column` and `col` functions be S4 functions

[ https://issues.apache.org/jira/browse/SPARK-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10079: -- Assignee: Sun Rui > Make `column` and `col` functions be S4 functions >

[jira] [Updated] (SPARK-10913) Add attach() function for DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10913: -- Assignee: Weiqiang Zhuang > Add attach() function for DataFrame >

[jira] [Resolved] (SPARK-10888) Add as.DataFrame as a synonym for createDataFrame

[ https://issues.apache.org/jira/browse/SPARK-10888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10888. --- Resolution: Fixed Assignee: Narine Kokhlikyan Fix Version/s:

[jira] [Resolved] (SPARK-10913) Add attach() function for DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10913. --- Resolution: Fixed Fix Version/s: 1.6.0 Resolved by

[jira] [Commented] (SPARK-11086) createDataFrame should dropFactor column-wise not cell-wise

[ https://issues.apache.org/jira/browse/SPARK-11086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955336#comment-14955336 ] Shivaram Venkataraman commented on SPARK-11086: --- This is a great suggestion. Could you open

[jira] [Commented] (SPARK-2563) Re-open sockets to handle connect timeouts

[ https://issues.apache.org/jira/browse/SPARK-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955269#comment-14955269 ] Shivaram Venkataraman commented on SPARK-2563: -- This bug was for the old NIO code. For 1.4.0

[jira] [Resolved] (SPARK-10051) Support collecting data of StructType in DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10051. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 1.6.0

[jira] [Resolved] (SPARK-10905) Export freqItems() for DataFrameStatFunctions in SparkR

[ https://issues.apache.org/jira/browse/SPARK-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10905. --- Resolution: Fixed Assignee: rerngvit yanggratoke Fix

[jira] [Commented] (SPARK-8840) Float type coercion with hiveContext

[ https://issues.apache.org/jira/browse/SPARK-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617363#comment-14617363 ] Shivaram Venkataraman commented on SPARK-8840: -- Ah I see -- Yes. we can

[jira] [Commented] (SPARK-8514) LU factorization on BlockMatrix

[ https://issues.apache.org/jira/browse/SPARK-8514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14618835#comment-14618835 ] Shivaram Venkataraman commented on SPARK-8514: -- I posted a link to a paper on

[jira] [Resolved] (SPARK-8897) SparkR DataFrame fail to return data of float type

[ https://issues.apache.org/jira/browse/SPARK-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8897. -- Resolution: Duplicate SparkR DataFrame fail to return data of float type

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14618863#comment-14618863 ] Shivaram Venkataraman commented on SPARK-8596: -- Thanks for the PR. Will

[jira] [Commented] (SPARK-8897) SparkR DataFrame fail to return data of float type

[ https://issues.apache.org/jira/browse/SPARK-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14618849#comment-14618849 ] Shivaram Venkataraman commented on SPARK-8897: -- [~sunrui] I'm closing this as

[jira] [Resolved] (SPARK-8894) Example code errors in SparkR documentation

[ https://issues.apache.org/jira/browse/SPARK-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8894. -- Resolution: Fixed Fix Version/s: 1.5.0 1.4.2 Issue

[jira] [Updated] (SPARK-8894) Example code errors in SparkR documentation

[ https://issues.apache.org/jira/browse/SPARK-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8894: - Assignee: Sun Rui Example code errors in SparkR documentation

[jira] [Created] (SPARK-8900) sparkPackages flag name is wrong in the documentation

Shivaram Venkataraman created SPARK-8900: Summary: sparkPackages flag name is wrong in the documentation Key: SPARK-8900 URL: https://issues.apache.org/jira/browse/SPARK-8900 Project: Spark

[jira] [Commented] (SPARK-8900) sparkPackages flag name is wrong in the documentation

[ https://issues.apache.org/jira/browse/SPARK-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14619036#comment-14619036 ] Shivaram Venkataraman commented on SPARK-8900: -- [~bashyal] You can take a

[jira] [Assigned] (SPARK-8900) sparkPackages flag name is wrong in the documentation

[ https://issues.apache.org/jira/browse/SPARK-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-8900: Assignee: Shivaram Venkataraman sparkPackages flag name is wrong in the

[jira] [Resolved] (SPARK-8900) sparkPackages flag name is wrong in the documentation

[ https://issues.apache.org/jira/browse/SPARK-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8900. -- Resolution: Fixed Fix Version/s: 1.5.0 1.4.2 Issue

[jira] [Commented] (SPARK-8951) support CJK characters in collect()

[ https://issues.apache.org/jira/browse/SPARK-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620809#comment-14620809 ] Shivaram Venkataraman commented on SPARK-8951: -- Yeah the right solution here

[jira] [Commented] (SPARK-8952) JsonFile() of SQLContext display improper warning message for a S3 path

[ https://issues.apache.org/jira/browse/SPARK-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620805#comment-14620805 ] Shivaram Venkataraman commented on SPARK-8952: -- This is a good point. I don't

[jira] [Resolved] (SPARK-8863) 'spark_ec2.py' doesn't check '~/.aws/credentials' even if boto can support '~/.aws/credentials'

[ https://issues.apache.org/jira/browse/SPARK-8863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8863. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-8863) 'spark_ec2.py' doesn't check '~/.aws/credentials' even if boto can support '~/.aws/credentials'

[ https://issues.apache.org/jira/browse/SPARK-8863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8863: - Assignee: Juhong Park 'spark_ec2.py' doesn't check '~/.aws/credentials' even if

[jira] [Commented] (SPARK-8939) YARN EC2 default setting fails with IllegalArgumentException

[ https://issues.apache.org/jira/browse/SPARK-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621074#comment-14621074 ] Shivaram Venkataraman commented on SPARK-8939: -- Hmm good catch -- Any ideas

[jira] [Commented] (SPARK-7909) spark-ec2 and associated tools not py3 ready

[ https://issues.apache.org/jira/browse/SPARK-7909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14619799#comment-14619799 ] Shivaram Venkataraman commented on SPARK-7909: -- I think we merged all the

[jira] [Commented] (SPARK-8939) YARN EC2 default setting fails with IllegalArgumentException

[ https://issues.apache.org/jira/browse/SPARK-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621125#comment-14621125 ] Shivaram Venkataraman commented on SPARK-8939: -- Okay -- [~lewuathe] feel free

[jira] [Commented] (SPARK-6831) Document how to use external data sources

[ https://issues.apache.org/jira/browse/SPARK-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620811#comment-14620811 ] Shivaram Venkataraman commented on SPARK-6831: -- [~yhuai] might be able to

[jira] [Updated] (SPARK-11773) Implement collection functions in SparkR

[ https://issues.apache.org/jira/browse/SPARK-11773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11773: -- Assignee: Sun Rui > Implement collection functions in SparkR >

[jira] [Resolved] (SPARK-11773) Implement collection functions in SparkR

[ https://issues.apache.org/jira/browse/SPARK-11773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11773. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-11281) Issue with creating and collecting DataFrame using environments

[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11281. --- Resolution: Fixed Assignee: Maciej Szymkiewicz Resolved by

<    1   2   3   4   5   6   7   8   9   10   >