Re: [VOTE] Release Apache Hadoop 3.4.1 RC2

[Mukund Madhav Thakur]

>
>
> > Do you think we can have an option to handle the overlapping ranges in
> Hadoop layer instead of introducing a breaking change to the users at the
> maintenance release?
>
>
On this one. We decided that we won't support overlapping ranges in
Vectored IO as that will cause complexity in memory management when
overlapping buffers have to be populated from a
large stream from S3.
Also this doesn't seem to be a valid customer use case. I don't think
ORC/Parquet will ever try to read overlapping ranges of data. What do you
think? Thanks