Re: [discuss] SparkR CRAN feasibility check server problem

2018-11-01 Thread Felix Cheung
Thanks for being this up and much appreciate with keeping on top of this at all times. Can upgrading R able to fix the issue. Is this perhaps not necessarily malform but some new format for new versions perhaps? Anyway we should consider upgrading R version if that fixes the problem. As an

[discuss] SparkR CRAN feasibility check server problem

2018-11-01 Thread Hyukjin Kwon
Hi all, I want to raise the CRAN failure issue because it started to block Spark PRs time to time. Since the number of PRs grows hugely in Spark community, this is critical to not block other PRs. There has been a problem at CRAN (See https://github.com/apache/spark/pull/20005 for analysis). To

Re: [VOTE] SPARK 2.4.0 (RC5)

2018-11-01 Thread Xiangrui Meng
Just FYI, not to block the release. We found an issue with PySpark barrier execution mode: https://issues.apache.org/jira/browse/SPARK-25921. We should list it as a known issues in the release notes and get it fixed in 2.4.1. -Xiangrui On Thu, Nov 1, 2018 at 12:19 AM Wenchen Fan wrote: > This

Re: DataSourceV2 hangouts sync

2018-11-01 Thread Ryan Blue
Thanks to everyone that attended the sync! We had some good discussions. Here are my notes for anyone that missed it or couldn’t join the live stream. If anyone wants to add to this, please send additional thoughts or corrections. *Attendees:* - Ryan Blue - Netflix - Using v2 to integrate

Removing deprecated items in Spark 3

2018-11-01 Thread Sean Owen
I took a pass at removing most of the older deprecated items in Spark. For discussion: https://github.com/apache/spark/pull/22921 - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [VOTE] SPARK 2.4.0 (RC5)

2018-11-01 Thread Wenchen Fan
This vote passes! I'll follow up with a formal release announcement soon. +1: Xiao Li (binding) Sean Owen (binding) Gengliang Wang Hyukjin Kwon Wenchen Fan (binding) Ryan Blue Bryan Cutler Marcelo Vanzin (binding) Reynold Xin (binding) Chitral Verma Dilip Biswal Denny Lee Felix Cheung (binding)