[jira] [Commented] (SPARK-31918) SparkR CRAN check gives a warning with R 4.0.0 on OSX

[ https://issues.apache.org/jira/browse/SPARK-31918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17155697#comment-17155697 ] Shivaram Venkataraman commented on SPARK-31918: --- Yes – this is the reason that SparkR has

[jira] [Commented] (SPARK-31918) SparkR CRAN check gives a warning with R 4.0.0 on OSX

[ https://issues.apache.org/jira/browse/SPARK-31918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142618#comment-17142618 ] Shivaram Venkataraman commented on SPARK-31918: --- Thats great! [~hyukjin.kwon] -- so we can

[jira] [Commented] (SPARK-31918) SparkR CRAN check gives a warning with R 4.0.0 on OSX

[ https://issues.apache.org/jira/browse/SPARK-31918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142558#comment-17142558 ] Shivaram Venkataraman commented on SPARK-31918: --- I can confirm that with build from source

[jira] [Commented] (SPARK-31918) SparkR CRAN check gives a warning with R 4.0.0 on OSX

[ https://issues.apache.org/jira/browse/SPARK-31918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142532#comment-17142532 ] Shivaram Venkataraman commented on SPARK-31918: --- [~hyukjin.kwon] I have R 4.0.2 and will

[jira] [Commented] (SPARK-31918) SparkR CRAN check gives a warning with R 4.0.0 on OSX

[ https://issues.apache.org/jira/browse/SPARK-31918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142466#comment-17142466 ] Shivaram Venkataraman commented on SPARK-31918: --- Thanks [~hyukjin.kwon]. It looks like

[jira] [Commented] (SPARK-32008) 3.0.0 release build fails

[ https://issues.apache.org/jira/browse/SPARK-32008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17137937#comment-17137937 ] Shivaram Venkataraman commented on SPARK-32008: --- It looks like the R vignette build failed

[jira] [Created] (SPARK-31918) SparkR CRAN check gives a warning with R 4.0.0

Shivaram Venkataraman created SPARK-31918: - Summary: SparkR CRAN check gives a warning with R 4.0.0 Key: SPARK-31918 URL: https://issues.apache.org/jira/browse/SPARK-31918 Project: Spark

[jira] [Updated] (SPARK-31918) SparkR CRAN check gives a warning with R 4.0.0 on OSX

[ https://issues.apache.org/jira/browse/SPARK-31918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-31918: -- Summary: SparkR CRAN check gives a warning with R 4.0.0 on OSX (was: SparkR

[jira] [Commented] (SPARK-24255) Require Java 8 in SparkR description

[ https://issues.apache.org/jira/browse/SPARK-24255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689038#comment-16689038 ] Shivaram Venkataraman commented on SPARK-24255: --- This is a great list -- I dont think we

[jira] [Commented] (SPARK-12172) Consider removing SparkR internal RDD APIs

[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16665254#comment-16665254 ] Shivaram Venkataraman commented on SPARK-12172: --- +1 - I think if spark.lapply uses only

[jira] [Commented] (SPARK-24535) Fix java version parsing in SparkR on Windows

[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535105#comment-16535105 ] Shivaram Venkataraman commented on SPARK-24535: --- Thanks [~felixcheung] -- I just got back

[jira] [Commented] (SPARK-24535) Fix java version parsing in SparkR

[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514020#comment-16514020 ] Shivaram Venkataraman commented on SPARK-24535: --- I was going to do it manually. If we do

[jira] [Commented] (SPARK-24535) Fix java version parsing in SparkR

[ https://issues.apache.org/jira/browse/SPARK-24535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514012#comment-16514012 ] Shivaram Venkataraman commented on SPARK-24535: --- I'm not sure if its only failing on

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513384#comment-16513384 ] Shivaram Venkataraman commented on SPARK-24359: --- Yes - thats what I meant [~felixcheung]

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513001#comment-16513001 ] Shivaram Venkataraman commented on SPARK-24359: --- Sounds good. Thanks [~falaki].

[jira] [Created] (SPARK-24535) Fix java version parsing in SparkR

Shivaram Venkataraman created SPARK-24535: - Summary: Fix java version parsing in SparkR Key: SPARK-24535 URL: https://issues.apache.org/jira/browse/SPARK-24535 Project: Spark Issue

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16501037#comment-16501037 ] Shivaram Venkataraman commented on SPARK-24359: --- If you have a separate repo that makes it 

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499612#comment-16499612 ] Shivaram Venkataraman commented on SPARK-24359: --- I think where the code sits matters if we

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16487754#comment-16487754 ] Shivaram Venkataraman commented on SPARK-24359: --- I'd just like to echo the point on release

[jira] [Commented] (SPARK-24272) Require Java 8 for SparkR

[ https://issues.apache.org/jira/browse/SPARK-24272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474546#comment-16474546 ] Shivaram Venkataraman commented on SPARK-24272: --- [~smilegator] - I opened

[jira] [Commented] (SPARK-24255) Require Java 8 in SparkR description

[ https://issues.apache.org/jira/browse/SPARK-24255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16472817#comment-16472817 ] Shivaram Venkataraman commented on SPARK-24255: --- Resolved by 

[jira] [Resolved] (SPARK-24255) Require Java 8 in SparkR description

[ https://issues.apache.org/jira/browse/SPARK-24255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-24255. --- Resolution: Fixed Assignee: Shivaram Venkataraman Fix

[jira] [Created] (SPARK-24255) Require Java 8 in SparkR description

Shivaram Venkataraman created SPARK-24255: - Summary: Require Java 8 in SparkR description Key: SPARK-24255 URL: https://issues.apache.org/jira/browse/SPARK-24255 Project: Spark Issue

[jira] [Commented] (SPARK-24152) Flaky Test: SparkR

[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461931#comment-16461931 ] Shivaram Venkataraman commented on SPARK-24152: --- If this is blocking all PRs I think its

[jira] [Commented] (SPARK-24152) Flaky Test: SparkR

[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461920#comment-16461920 ] Shivaram Venkataraman commented on SPARK-24152: --- Unfortunately I dont have time to look at

[jira] [Commented] (SPARK-24023) Built-in SQL Functions improvement in SparkR

[ https://issues.apache.org/jira/browse/SPARK-24023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448835#comment-16448835 ] Shivaram Venkataraman commented on SPARK-24023: --- Thanks [~hyukjin.kwon] . +1 to what Felix

[jira] [Commented] (SPARK-16693) Remove R deprecated methods

[ https://issues.apache.org/jira/browse/SPARK-16693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308765#comment-16308765 ] Shivaram Venkataraman commented on SPARK-16693: --- Did we have the discussion on dev@ ? I

[jira] [Created] (SPARK-22889) CRAN checks can fail if older Spark install exists

Shivaram Venkataraman created SPARK-22889: - Summary: CRAN checks can fail if older Spark install exists Key: SPARK-22889 URL: https://issues.apache.org/jira/browse/SPARK-22889 Project: Spark

[jira] [Resolved] (SPARK-22315) Check for version match between R package and JVM

[ https://issues.apache.org/jira/browse/SPARK-22315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-22315. --- Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Issue

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16234372#comment-16234372 ] Shivaram Venkataraman commented on SPARK-22344: --- Right I was considering that - but

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16233683#comment-16233683 ] Shivaram Venkataraman commented on SPARK-22344: --- So I started working on this but this is a

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225924#comment-16225924 ] Shivaram Venkataraman commented on SPARK-22344: --- To consider this narrow case of CRAN

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224301#comment-16224301 ] Shivaram Venkataraman commented on SPARK-22344: --- well uninstall is just removing

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223844#comment-16223844 ] Shivaram Venkataraman commented on SPARK-22344: --- The ~/.cache is created by `install.spark`

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220884#comment-16220884 ] Shivaram Venkataraman commented on SPARK-22344: --- Thanks for investigating. Is

[jira] [Created] (SPARK-22344) Prevent R CMD check from using /tmp

Shivaram Venkataraman created SPARK-22344: - Summary: Prevent R CMD check from using /tmp Key: SPARK-22344 URL: https://issues.apache.org/jira/browse/SPARK-22344 Project: Spark Issue

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217310#comment-16217310 ] Shivaram Venkataraman commented on SPARK-15799: --- I created

[jira] [Commented] (SPARK-22281) Handle R method breaking signature changes

[ https://issues.apache.org/jira/browse/SPARK-22281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214663#comment-16214663 ] Shivaram Venkataraman commented on SPARK-22281: --- Thanks for looking into this

[jira] [Created] (SPARK-22315) Check for version match between R package and JVM

Shivaram Venkataraman created SPARK-22315: - Summary: Check for version match between R package and JVM Key: SPARK-22315 URL: https://issues.apache.org/jira/browse/SPARK-22315 Project: Spark

[jira] [Commented] (SPARK-17902) collect() ignores stringsAsFactors

[ https://issues.apache.org/jira/browse/SPARK-17902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16209927#comment-16209927 ] Shivaram Venkataraman commented on SPARK-17902: --- I think [~falaki] might have a test case

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202260#comment-16202260 ] Shivaram Venkataraman commented on SPARK-15799: --- This is now live !

[jira] [Resolved] (SPARK-15799) Release SparkR on CRAN

[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15799. --- Resolution: Fixed Assignee: Shivaram Venkataraman Fix

[jira] [Commented] (SPARK-22202) Release tgz content differences for python and R

[ https://issues.apache.org/jira/browse/SPARK-22202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193111#comment-16193111 ] Shivaram Venkataraman commented on SPARK-22202: --- I think the differences happen because we

[jira] [Commented] (SPARK-22063) Upgrade lintr to latest commit sha1 ID

[ https://issues.apache.org/jira/browse/SPARK-22063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16187551#comment-16187551 ] Shivaram Venkataraman commented on SPARK-22063: --- [~shaneknapp] [~felixcheung] Lets move the

[jira] [Commented] (SPARK-21349) Make TASK_SIZE_TO_WARN_KB configurable

[ https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146624#comment-16146624 ] Shivaram Venkataraman commented on SPARK-21349: --- Thanks for checking. In that case I dont

[jira] [Commented] (SPARK-21349) Make TASK_SIZE_TO_WARN_KB configurable

[ https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146585#comment-16146585 ] Shivaram Venkataraman commented on SPARK-21349: --- I think this might be that we create a

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138602#comment-16138602 ] Shivaram Venkataraman commented on SPARK-15799: --- The email I got from CRAN is pasted below.

[jira] [Commented] (SPARK-6809) Make numPartitions optional in pairRDD APIs

[ https://issues.apache.org/jira/browse/SPARK-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101900#comment-16101900 ] Shivaram Venkataraman commented on SPARK-6809: -- Yeah I dont this JIRA is applicable any more.

[jira] [Resolved] (SPARK-6809) Make numPartitions optional in pairRDD APIs

[ https://issues.apache.org/jira/browse/SPARK-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6809. -- Resolution: Not A Problem > Make numPartitions optional in pairRDD APIs >

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082775#comment-16082775 ] Shivaram Venkataraman commented on SPARK-21367: --- Is there anyway to get more info on the

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082708#comment-16082708 ] Shivaram Venkataraman commented on SPARK-21367: --- >From [~felixcheung]'s earlier parsing of

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081223#comment-16081223 ] Shivaram Venkataraman commented on SPARK-21367: --- [~dongjoon] Do you have a particular

[jira] [Commented] (SPARK-21349) Make TASK_SIZE_TO_WARN_KB configurable

[ https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080875#comment-16080875 ] Shivaram Venkataraman commented on SPARK-21349: --- Well 100K is already too large IMHO and

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080826#comment-16080826 ] Shivaram Venkataraman commented on SPARK-21367: --- I just checked the transitive dependencies

[jira] [Commented] (SPARK-21093) Multiple gapply execution occasionally failed in SparkR

[ https://issues.apache.org/jira/browse/SPARK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16051094#comment-16051094 ] Shivaram Venkataraman commented on SPARK-21093: --- Thanks [~hyukjin.kwon] -- thats a very

[jira] [Commented] (SPARK-21093) Multiple gapply execution occasionally failed in SparkR

[ https://issues.apache.org/jira/browse/SPARK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049361#comment-16049361 ] Shivaram Venkataraman commented on SPARK-21093: --- So it looks like the R worker process

[jira] [Assigned] (SPARK-20877) Investigate if tests will time out on CRAN

[ https://issues.apache.org/jira/browse/SPARK-20877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-20877: - Assignee: Felix Cheung > Investigate if tests will time out on CRAN >

[jira] [Resolved] (SPARK-20877) Investigate if tests will time out on CRAN

[ https://issues.apache.org/jira/browse/SPARK-20877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-20877. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request

[jira] [Commented] (SPARK-20877) Investigate if tests will time out on CRAN

[ https://issues.apache.org/jira/browse/SPARK-20877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027870#comment-16027870 ] Shivaram Venkataraman commented on SPARK-20877: --- I managed to get the tests to pass on a

[jira] [Commented] (SPARK-20877) Investigate if tests will time out on CRAN

[ https://issues.apache.org/jira/browse/SPARK-20877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025878#comment-16025878 ] Shivaram Venkataraman commented on SPARK-20877: --- I've been investigating the breakdown of

[jira] [Created] (SPARK-20727) Skip SparkR tests when missing Hadoop winutils on CRAN windows machines

Shivaram Venkataraman created SPARK-20727: - Summary: Skip SparkR tests when missing Hadoop winutils on CRAN windows machines Key: SPARK-20727 URL: https://issues.apache.org/jira/browse/SPARK-20727

[jira] [Assigned] (SPARK-20613) Double quotes in Windows batch script

[ https://issues.apache.org/jira/browse/SPARK-20613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-20613: - Assignee: Jarrett Meyer > Double quotes in Windows batch script >

[jira] [Assigned] (SPARK-19237) SparkR package on Windows waiting for a long time when no java is found launching spark-submit

[ https://issues.apache.org/jira/browse/SPARK-19237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-19237: - Assignee: Felix Cheung > SparkR package on Windows waiting for a long

[jira] [Resolved] (SPARK-19237) SparkR package on Windows waiting for a long time when no java is found launching spark-submit

[ https://issues.apache.org/jira/browse/SPARK-19237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-19237. --- Resolution: Fixed Fix Version/s: 2.2.0 2.1.1 Issue

[jira] [Commented] (SPARK-19796) taskScheduler fails serializing long statements received by thrift server

[ https://issues.apache.org/jira/browse/SPARK-19796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893736#comment-15893736 ] Shivaram Venkataraman commented on SPARK-19796: --- I think (a) is worth exploring in a new

[jira] [Resolved] (SPARK-19387) CRAN tests do not run with SparkR source package

[ https://issues.apache.org/jira/browse/SPARK-19387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-19387. --- Resolution: Fixed Fix Version/s: 2.2.0 2.1.1 Issue

[jira] [Commented] (SPARK-19568) Must include class/method documentation for CRAN check

[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865022#comment-15865022 ] Shivaram Venkataraman commented on SPARK-19568: --- Is it possible to add this as a part of

[jira] [Commented] (SPARK-19571) appveyor windows tests are failing

[ https://issues.apache.org/jira/browse/SPARK-19571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15864033#comment-15864033 ] Shivaram Venkataraman commented on SPARK-19571: --- cc [~hyukjin.kwon] > appveyor windows

[jira] [Created] (SPARK-19487) Low latency execution for Spark

Shivaram Venkataraman created SPARK-19487: - Summary: Low latency execution for Spark Key: SPARK-19487 URL: https://issues.apache.org/jira/browse/SPARK-19487 Project: Spark Issue

[jira] [Created] (SPARK-19486) Investigate using multiple threads for task serialization

Shivaram Venkataraman created SPARK-19486: - Summary: Investigate using multiple threads for task serialization Key: SPARK-19486 URL: https://issues.apache.org/jira/browse/SPARK-19486 Project:

[jira] [Created] (SPARK-19485) Launch tasks async i.e. dont wait for the network

Shivaram Venkataraman created SPARK-19485: - Summary: Launch tasks async i.e. dont wait for the network Key: SPARK-19485 URL: https://issues.apache.org/jira/browse/SPARK-19485 Project: Spark

[jira] (SPARK-18131) Support returning Vector/Dense Vector from backend

[ https://issues.apache.org/jira/browse/SPARK-18131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847473#comment-15847473 ] Shivaram Venkataraman commented on SPARK-18131: --- Hmm - this is tricky. We ran into a

[jira] [Resolved] (SPARK-19324) JVM stdout output is dropped in SparkR

[ https://issues.apache.org/jira/browse/SPARK-19324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-19324. --- Resolution: Fixed Fix Version/s: 2.2.0 2.1.1

[jira] [Commented] (SPARK-16578) Configurable hostname for RBackend

[ https://issues.apache.org/jira/browse/SPARK-16578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827237#comment-15827237 ] Shivaram Venkataraman commented on SPARK-16578: --- I think its fine to remove the target

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827066#comment-15827066 ] Shivaram Venkataraman commented on SPARK-15799: --- The work on this is mostly complete - But

[jira] [Resolved] (SPARK-19232) SparkR distribution cache location is wrong on Windows

[ https://issues.apache.org/jira/browse/SPARK-19232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-19232. --- Resolution: Fixed Fix Version/s: 2.2.0 2.1.1 Issue

[jira] [Resolved] (SPARK-19221) Add winutils binaries to Path in AppVeyor for Hadoop libraries to call native libraries properly

[ https://issues.apache.org/jira/browse/SPARK-19221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-19221. --- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.2.0

[jira] [Resolved] (SPARK-18335) Add a numSlices parameter to SparkR's createDataFrame

[ https://issues.apache.org/jira/browse/SPARK-18335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-18335. --- Resolution: Fixed Fix Version/s: 2.2.0 2.1.1 Issue

[jira] [Commented] (SPARK-19177) SparkR Data Frame operation between columns elements

[ https://issues.apache.org/jira/browse/SPARK-19177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15821986#comment-15821986 ] Shivaram Venkataraman commented on SPARK-19177: --- Thanks for the example - this is very

[jira] [Commented] (SPARK-18823) Assignation by column name variable not available or bug?

[ https://issues.apache.org/jira/browse/SPARK-18823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819446#comment-15819446 ] Shivaram Venkataraman commented on SPARK-18823: --- Yeah I think it makes sense to not handle

[jira] [Resolved] (SPARK-19130) SparkR should support setting and adding new column with singular value implicitly

[ https://issues.apache.org/jira/browse/SPARK-19130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-19130. --- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.2.0

[jira] [Commented] (SPARK-19177) SparkR Data Frame operation between columns elements

[ https://issues.apache.org/jira/browse/SPARK-19177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819260#comment-15819260 ] Shivaram Venkataraman commented on SPARK-19177: --- Thanks [~masip85] - Can you include a

[jira] [Commented] (SPARK-19108) Broadcast all shared parts of tasks (to reduce task serialization time)

[ https://issues.apache.org/jira/browse/SPARK-19108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15806774#comment-15806774 ] Shivaram Venkataraman commented on SPARK-19108: --- +1 - This is a good idea. One thing I'd

[jira] [Commented] (SPARK-18924) Improve collect/createDataFrame performance in SparkR

[ https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771602#comment-15771602 ] Shivaram Venkataraman commented on SPARK-18924: --- Yeah I think we could convert this JIRA

[jira] [Updated] (SPARK-18836) Serialize Task Metrics once per stage

[ https://issues.apache.org/jira/browse/SPARK-18836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-18836: -- Fix Version/s: (was: 1.3.0) 2.2.0 > Serialize Task

[jira] [Commented] (SPARK-18924) Improve collect/createDataFrame performance in SparkR

[ https://issues.apache.org/jira/browse/SPARK-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762548#comment-15762548 ] Shivaram Venkataraman commented on SPARK-18924: --- This is a good thing to investigate - Just

[jira] [Commented] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15756403#comment-15756403 ] Shivaram Venkataraman commented on SPARK-18817: --- [~felixcheung] What do you think are the

[jira] [Resolved] (SPARK-18895) Fix resource-closing-related and path-related test failures in identified ones on Windows

[ https://issues.apache.org/jira/browse/SPARK-18895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-18895. --- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.2.0

[jira] [Commented] (SPARK-18902) Include Apache License in R source Package

[ https://issues.apache.org/jira/browse/SPARK-18902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15755386#comment-15755386 ] Shivaram Venkataraman commented on SPARK-18902: --- A couple of points - We already include a

[jira] [Commented] (SPARK-18902) Include Apache License in R source Package

[ https://issues.apache.org/jira/browse/SPARK-18902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15755385#comment-15755385 ] Shivaram Venkataraman commented on SPARK-18902: --- A couple of points - We already include a

[jira] [Created] (SPARK-18902) Include Apache License in R source Package

Shivaram Venkataraman created SPARK-18902: - Summary: Include Apache License in R source Package Key: SPARK-18902 URL: https://issues.apache.org/jira/browse/SPARK-18902 Project: Spark

[jira] [Updated] (SPARK-18897) Fix SparkR SQL Test to drop test table

[ https://issues.apache.org/jira/browse/SPARK-18897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-18897: -- Fix Version/s: (was: 2.1.0) 2.2.0

[jira] [Updated] (SPARK-18897) Fix SparkR SQL Test to drop test table

[ https://issues.apache.org/jira/browse/SPARK-18897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-18897: -- Assignee: Dongjoon Hyun > Fix SparkR SQL Test to drop test table >

[jira] [Resolved] (SPARK-18897) Fix SparkR SQL Test to drop test table

[ https://issues.apache.org/jira/browse/SPARK-18897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-18897. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.3 Issue

[jira] [Commented] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753588#comment-15753588 ] Shivaram Venkataraman commented on SPARK-18817: --- Just to check - Is your Spark installation

[jira] [Commented] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752973#comment-15752973 ] Shivaram Venkataraman commented on SPARK-18817: --- In that case an easier fix might be to

[jira] [Commented] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752902#comment-15752902 ] Shivaram Venkataraman commented on SPARK-18817: --- [~bdwyer] Does this still happen if you

[jira] [Commented] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752898#comment-15752898 ] Shivaram Venkataraman commented on SPARK-18817: --- Yeah I dont know how to avoid creating

[jira] [Resolved] (SPARK-18849) Vignettes final checks for Spark 2.1

[ https://issues.apache.org/jira/browse/SPARK-18849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-18849. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request

[jira] [Updated] (SPARK-18875) Fix R API doc generation by adding `DESCRIPTION` file

[ https://issues.apache.org/jira/browse/SPARK-18875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-18875: -- Assignee: Dongjoon Hyun > Fix R API doc generation by adding `DESCRIPTION`

  1   2   3   4   5   6   7   8   9   10   >