Hi,
Hudi can run in spark. Storage doesn't matter. If you configure ur spark
use s3 filesystem that is enough.
Thanks and Regards,
S SYED ABDUL KATHER
On Tue, Jan 7, 2020 at 12:28 PM OpenInx <[email protected]> wrote:
> Hi
>
> I know that the Hudi can only running on HDFS, while s3 is much cheaper
> than hdfs storage. so just ask:
> any plan to support hudi + s3, say make the storage layer to be pluggable ,
> and have the hdfs/s3/oss impl etc.
> btw do we hudi have the strong dependency on the atomic rename semantic ?
> If sure, it may be some problem
> to move it to s3 ?
>
> Thanks.
>
