Re: [DISCUSS] Dropping Spark 3.0.x support in 0.11

2022-01-23 Thread Vinoth Chandar
+1 for this. The rate of API breakages across minor Spark versions are bit
untenable anyway.

On Wed, Jan 12, 2022 at 1:22 AM Raymond Xu 
wrote:

> Hi Chen,
>
> yes this is actually been worked on by liujinhui
> https://issues.apache.org/jira/browse/HUDI-2370
>
> and it's planned for 0.11
>
> --
> Best,
> Raymond
>
>
> On Sun, Jan 9, 2022 at 4:22 PM 陈 翔  wrote:
>
> > There is an other thing I care about: in spark 3.2.0, parquet 1.12
> > introduces the function of encryption.
> >
> >
> https://spark.apache.org/docs/latest/sql-data-sources-parquet.html#columnar-encryption
> > Do we have plans to introduce this feature into hudi? I think this
> > function is a great help to the security of the data lake
> >
> >
> > 发件人: Raymond Xu 
> > 日期: 星期一, 2022年1月10日 上午5:48
> > 收件人: dev@hudi.apache.org 
> > 主题: [DISCUSS] Dropping Spark 3.0.x support in 0.11
> > Hi all,
> >
> > The incompatible changes from different Spark 3 versions, namely spark
> > 3.0.x, spark 3.1.x, and the latest spark 3.2, are making the spark
> support
> > difficult. I'm proposing to drop Spark 3.0.x support from the next major
> > release 0.11.0. Spark 3.0.x has been supported since 0.7.0 through
> 0.10.0.
> > The Spark 3 support matrix will look like
> >
> >- 0.11.0
> >   - 3.2.0 (default build), 3.1.x
> >- 0.10.x
> >   - 3.1.x (default build), 3.0.x
> >- 0.7.0 - 0.9.0
> >   - 3.0.x
> >- 0.6.0 and prior
> >   - not supported
> >
> > Thanks.
> >
> > Best,
> > Raymond
> >
>


Re: [VOTE] Release 0.10.1, release candidate #2

2022-01-23 Thread Nishith
+1 binding

-Nishith

> On Jan 22, 2022, at 7:49 PM, Vinoth Chandar  wrote:
> 
> +1 (binding)
> 
> Ran my rc checks on updated link and changing my vote to a +1
> 
>> On Sat, Jan 22, 2022 at 4:10 AM Sivabalan  wrote:
>> 
>> my bad, the link([2]) was wrong. It is
>> https://dist.apache.org/repos/dist/dev/hudi/hudi-0.10.1-rc2/.
>> Can you take a look please?
>> 
>>> On Sat, 22 Jan 2022 at 00:08, Vinoth Chandar  wrote:
>>> 
>>> -1
>>> 
>>> The artifact version is wrong! It should be 0.10.*1*
>>> 
>>> 
>>>   - hudi-0.10.0-rc2.src.tgz
>>>   <
>>> 
>> https://dist.apache.org/repos/dist/dev/hudi/hudi-0.10.0-rc2/hudi-0.10.0-rc2.src.tgz
 
>>>   - hudi-0.10.0-rc2.src.tgz.asc
>>>   <
>>> 
>> https://dist.apache.org/repos/dist/dev/hudi/hudi-0.10.0-rc2/hudi-0.10.0-rc2.src.tgz.asc
 
>>>   - hudi-0.10.0-rc2.src.tgz.sha512
>>>   <
>>> 
>> https://dist.apache.org/repos/dist/dev/hudi/hudi-0.10.0-rc2/hudi-0.10.0-rc2.src.tgz.sha512
 
>>> 
>>> grep version hudi-0.10.0-rc2/pom.xml | grep rc2
>>>  0.10.0-rc2
>>> 
>>> 
>>> Why are all the arc
>>> 
 On Thu, Jan 20, 2022 at 3:53 AM Sivabalan  wrote:
>>> 
 Hi everyone,
 
 Please review and vote on the release candidate #2 for the version
>>> 0.10.1,
 as follows:
 
 [ ] +1, Approve the release
 
 [ ] -1, Do not approve the release (please provide specific comments)
 
 
 The complete staging area is available for your review, which includes:
 
 * JIRA release notes [1],
 
 * the official Apache source release and binary convenience releases to
>>> be
 deployed to dist.apache.org [2], which are signed with the key with
 fingerprint ACD52A06633DB3B2C7D0EA5642CA2D3ED5895122 [3],
 
 * all artifacts to be deployed to the Maven Central Repository [4],
 
 * source code tag "release-0.10.1-rc2" [5],
 
 
 The vote will be open for at least 72 hours. It is adopted by majority
 approval, with at least 3 PMC affirmative votes.
 
 
 Thanks,
 Release Manager
 
 
 [1]
 
 
>>> 
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822=12351135
 
 [2] https://dist.apache.org/repos/dist/dev/hudi/hudi-0.10.0-rc2
 
 [3] https://dist.apache.org/repos/dist/dev/hudi/KEYS
 
 [4]
 
 
>>> 
>> https://repository.apache.org/content/repositories/orgapachehudi-1052/org/apache/hudi/
 
 [5] https://github.com/apache/hudi/tree/release-0.10.1-rc2
 
 --
 Regards,
 -Sivabalan
 
>>> 
>> 
>> 
>> --
>> Regards,
>> -Sivabalan
>>