Re: [DISCUSS] SPIP: Add PySpark Test Framework

2023-06-14 Thread Ruifeng Zheng
+1 from my side sounds good, it will be helpful to both users and contributors to improve the test coverage On Wed, Jun 14, 2023 at 8:27 AM Hyukjin Kwon wrote: > Yeah, I have been thinking about this too, and Holden did some work here > that this SPIP will reuse. I support this. > > On Wed, 14

Add user as a contributor

2023-06-14 Thread Aman Raj
Hi team, Can someone please help giving contributor access to amanraj2520 username. I have raised a Spark Ticket : issues.apache.org/jira/browse/SPARK-44058. I am not able to assign this to myself. Thanks, Aman.

Re: Add user as a contributor

2023-06-14 Thread Hyukjin Kwon
You can open a PR first. When that's merged, the ticket will be assigned to you with the contribuor access On Thu, Jun 15, 2023 at 1:07 PM Aman Raj wrote: > Hi team, > > Can someone please help giving contributor access to amanraj2520 username. > I have raised a Spark Ticket :

Re: [EXTERNAL] Re: Add user as a contributor

2023-06-14 Thread Aman Raj
Thanks Hyukjin. Will do so. Thanks, Aman. From: Hyukjin Kwon Sent: Thursday, June 15, 2023 9:39 AM To: Aman Raj Cc: dev@spark.apache.org Subject: [EXTERNAL] Re: Add user as a contributor You don't often get email from gurwls...@apache.org. Learn why this is

Re: Data Contracts

2023-06-14 Thread Jean-Georges Perrin
Hi, While I was at PayPal, we open sourced a template of Data Contract, it is here: https://github.com/paypal/data-contract-template. Companies like GX (Great Expectations) are interested in using it. Spark could read some elements form it pretty easily, like schema validation, some rules