Re: [VOTE] Release Apache Spark 2.4.5 (RC1)

2020-01-13 Thread Dongjoon Hyun
+1. I verified with GPG and tested RC1 with the followings. - Profile: -Pyarn -Phadoop-2.7 -Pkubernetes -Pkinesis-asl -Phive -Phive-thriftserver - Java: OpenJDK 1.8.0_232 - OS: CentOS (7.5.1804) - All Scala/Java UTs and JDBC IT passed. - Test with Amazon EKS Client Version: v1.17.0

Re: Question about Datasource V2(Internet mail)

2020-01-13 Thread 马骏杰
Thanks for clarification, Wenchen. I’ll create JIRA for item 2 and do some investigation on UDF catalog. From: Wenchen Fan Date: Monday, January 13, 2020 at 4:17 PM To: "colinma(马骏杰)" Cc: "dev@spark.apache.org" Subject: Re: Question about Datasource V2(Internet mail) 1. we plan to add view

[VOTE] Release Apache Spark 2.4.5 (RC1)

2020-01-13 Thread Dongjoon Hyun
Please vote on releasing the following candidate as Apache Spark version 2.4.5. The vote is open until January 16th 5AM PST and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 2.4.5 [ ] -1 Do not release this package because

Re: Question about Datasource V2

2020-01-13 Thread Wenchen Fan
1. we plan to add view support in future releases. 2. can you open a JIRA ticket? This seems like a bug to me. 3. instead of defining a lot of fields in the table, we decide to use properties to keep all the extra information. We've defined some reserved properties like "comment", "location",