Hi Rahul,
I don't have a direct answer to your question as I don't know of any
S3 based Directory implementation. Such an implementation would likely
be more complex than an HDFS one.
Reason is S3 has eventual consistency. When an S3 file is updated you
might still read the old content for a
Thanks David, Mike and Shalin. Glad you find this useful!
Mike, do you mind pointing out here or in the doc which of the bugs
you saw in production? That way I can start filing Jiras for actual
issues.
Ilan
On Fri, Apr 24, 2020 at 4:01 AM Shalin Shekhar Mangar
wrote:
>
> This is good stuff
#2 and #8 were the ones that immediately jumped out at me.
On 2020/04/24 10:33:55, Ilan Ginzburg wrote:
> Thanks David, Mike and Shalin. Glad you find this useful!
>
> Mike, do you mind pointing out here or in the doc which of the bugs
> you saw in production? That way I can start filing Jiras
Agreed this is great and difficult work, Ilan. Thanks so much for taking it on.
I wonder if some of this maybe should end up in Javadocs? If those classes
don’t say what they’re doing or seem incomplete (and I have no idea what they
say about themselves) then we should consider maybe using some
