Re: Spark 3.3 + parquet 1.10

2023-07-24 Thread Mich Talebzadeh
personally I have not done it myself. CCed to spark user group if some user has tried it among users. HTH Mich Talebzadeh, Solutions Architect/Engineering Lead Palantir Technologies Limited London United Kingdom view my Linkedin profile

Spark3.3 with parquet 1.10.x

2023-07-24 Thread Pralabh Kumar
Hi Spark Users . I have a quick question with respect to Spark 3.3. Currently Spark 3.3 is built with parquet 1.12. However, anyone tried Spark 3.3 with parquet 1.10 . We are at Uber , planning to migrate Spark 3.3 but we have limitations of using parquet 1.10 . Has anyone tried building Spark

Re: Interested in contributing to SPARK-24815

2023-07-24 Thread Sean Owen
When contributing to an ASF project, it's governed by the terms of the ASF ICLA: https://www.apache.org/licenses/icla.pdf or CCLA: https://www.apache.org/licenses/cla-corporate.pdf I don't believe ASF projects ever retain an original author copyright statement, but rather source files have a

Fwd: Interested in contributing to SPARK-24815

2023-07-24 Thread Pavan Kotikalapudi
Hi Spark Dev, My name is Pavan Kotikalapudi, I work at Twilio. I am looking to contribute to this spark issue https://issues.apache.org/jira/browse/SPARK-24815. There is a clause from the company's OSS saying - The proposed contribution is about 100 lines of code modification in the Spark