Hey Allesandro,

Welcome to the community!
Currently ORC has a hard dependency on the Hadoop FS -- so the easiest way
to use the Writer would be to directly write to disk.
There is an ongoing effort to remove this (undeeded) dependency -- see
ORC-508  <https://issues.apache.org/jira/browse/ORC-508> and a fairly
recent PR <https://github.com/apache/orc/pull/641>  by Owen if you want to
hack around.
An alternative would be to use a custom in-memory FS as we currently do for
some tests
<https://github.com/pgaref/orc/blob/master/java/core/src/test/org/apache/orc/impl/TestPhysicalFsWriter.java#L168>
.

Hope this helps!

Cheers,
Panagiotis

On Wed, Mar 3, 2021 at 10:15 AM Alessandro D'Armiento <
alessandro.darmiento1...@gmail.com> wrote:

> Good morning,
> I am using the Orc-core Java library for the first time.
> I could not find in the documentation a way to use the Orc File Writer to
> create Orc files, but instead of writing them to disk, retain the bytearray
> to have the actual writing handled by some other system.
> Is this natively possible?
> I also thought about using stuff like Google jimfs to create a file in
> memory and then reading it, but it's suboptimal.
>
> Thanks,
> Alessandro
>

Reply via email to