Hi Atour, Thanks for bringing this up!
>From what I observed from PARQUET-1822, I think it is a valid use case to support parquet reading/writing without hadoop installed. The challenge is backward compatibility. It would be great if you can work on it. Best, Gang On Fri, Jun 9, 2023 at 12:24 AM Atour Mousavi Gourabi <[email protected]> wrote: > Dear all, > > The Java implementations of the Parquet readers and writers seem pretty > tightly coupled to Hadoop (see: PARQUET-1822). For some projects, this can > cause issues as it's an unnecessary and big dependency when you might just > need to write to disk. Is there any appetite here for separating the Hadoop > code and supporting more convenient ways to write to disk out of the box? I > am willing to work on these changes but would like some pointers on whether > such patches would be reviewed and accepted as PARQUET-1822 has been open > for over three years now. > > Best regards, > Atour Mousavi Gourabi >
