rquet Dev
> *Cc:* fa...@sumologic.com; Radev, Martin
> *Subject:* Re: custom CompressionCodec support
>
> Yes, thats the flag we tried and ensured its getting read and propagated.
>
> Regards
> Manik Singla
> +91-9996008893
> +91-9665639677
>
> "Life doesn't co
: Re: custom CompressionCodec support
Yes, thats the flag we tried and ensured its getting read and propagated.
Regards
Manik Singla
+91-9996008893
+91-9665639677
"Life doesn't consist in holding good cards but playing those you hold well."
On Mon, Oct 21, 2019 at 12:51 PM Driesprong, Fo
e of what's supported by the
> codec.
> > > For
> > > > ZSTD, the range should be [1, 22].
> > > >
> > > > Let me know if you're using Arrow and I can check locally that there
> > > isn't
> > > > by any chance a bug with propagatin
he moment there are
> > > only smoke tests that nothing crashes.
> > >
> > >
> > > Regards,
> > >
> > > Martin
> > > --
> > > *From:* Falak Kansal
> > > *Sent:* Thursday, October 17,
rds,
> >
> > Martin
> > ----------
> > *From:* Falak Kansal
> > *Sent:* Thursday, October 17, 2019 4:43:54 PM
> > *To:* Driesprong, Fokko
> > *Cc:* dev@parquet.apache.org
> > *Subject:* Re: custom CompressionCodec support
> >
> >
t there are
> only smoke tests that nothing crashes.
>
>
> Regards,
>
> Martin
> --
> *From:* Falak Kansal
> *Sent:* Thursday, October 17, 2019 4:43:54 PM
> *To:* Driesprong, Fokko
> *Cc:* dev@parquet.apache.org
> *Subject:* Re: custom Com
CompressionCodec support
Hi Fokko,
Thanks for replying, yes sure.
The problem we are facing is that with parquet zstd we are not able to
control the compression level, we tried setting different compression
levels but it doesn't make any difference in the size. We tested/have made
sure that we are getting
Hi Fokko,
Thanks for replying, yes sure.
The problem we are facing is that with parquet zstd we are not able to
control the compression level, we tried setting different compression
levels but it doesn't make any difference in the size. We tested/have made
sure that we are getting the same
Hi Manik,
The supported compression codecs that ship with Parquet are tested and
validated in the CI pipeline. Sometimes there are issues with compressors,
therefore they are not easily pluggable. Feel free to open up a PR to the
project if you believe if there are compressors missing, then we
Hi
Current java code is not open to use custom compressor.
I believe mostly read/write is done by same team/company. In that case, it
would be beneficial to add this support that user can plug new compressor
easily instead of doing local changes which will be prone to uses across
version
10 matches
Mail list logo
