Re: Video chat this week

2020-03-25 Thread Christopher
This need not be a one-time thing. We can do this more regularly. I'll try to remember to have a call open in Slack whenever I'm available to chat. My plan is to be back on at 1330 (New York / DC time) on Thursday, if anybody wants to join then. On Wed, Mar 25, 2020 at 2:58 PM Drew Farris wrote:

Re: Slack call notes

2020-03-25 Thread Christopher
Replied in a new thread. On Wed, Mar 25, 2020 at 2:08 PM wrote: > > > I couldn't make the call today, but am curious if anyone has previously > brought up creating a FileSystem API for Accumulo so that we could use > implementations other than Hadoop. I realize that Hadoop provides >

FileSystem API (was: Slack call notes)

2020-03-25 Thread Christopher
(Forking this thread, as it's a distinct topic) I've thought about it. The idea has driven me to try to reduce our use of Hadoop-specific code, and to isolate Hadoop-specific stuff behind some abstraction, wherever possible. Though, I'll admit, we're nowhere close to where we'd want to be to be

Re: FileSystem API (was: Slack call notes)

2020-03-25 Thread David Mollitor
Hello, I too have been thinking about this for a pet project. There is already Apache Commons VFS that, with some investment, could probably serve all these requirements. On Wed, Mar 25, 2020, 3:16 PM Christopher wrote: > (Forking this thread, as it's a distinct topic) > > I've thought about

Re: Video chat this week

2020-03-25 Thread Drew Farris
Bummer, I missed it. Time to get the accumulo-dev list flowing directly to my inbox. Thanks for sharing the summary Christopher. Drew On Tue, Mar 24, 2020 at 3:45 PM Christopher wrote: > Okay, let's try Slack around 1130 on Wednesday. I might also just > start a call in Slack at various times,

RE: Slack call notes

2020-03-25 Thread dlmarion
I couldn't make the call today, but am curious if anyone has previously brought up creating a FileSystem API for Accumulo so that we could use implementations other than Hadoop. I realize that Hadoop provides implementations for things other than HDFS but that doesn't necessarily mean that

Slack call notes

2020-03-25 Thread Christopher
Several committers/contributors in the community joined a call in Slack on Wednesday, at 1130-1230, New York (Eastern) time. Here are my notes of the call. Please feel free to add to them. I shared the overall philosophy and backstory to some of the script improvements in 2.x to help guide

Re: FileSystem API (was: Slack call notes)

2020-03-25 Thread Mike Miller
I think we have come a long way removing any external types from the API, for reasons other than de-coupling from Hadoop. While we don't have many dependencies on the other components of Hadoop, we are still very tightly coupled to HDFS. For example, some quick grep'ing of the code shows: "grep

Re: FileSystem API (was: Slack call notes)

2020-03-25 Thread Christopher
Only 705 across 280 files, if you exclude Text, though :) grep -rP 'org[.]apache[.]hadoop(?![.]io[.]Text)' --include='*.java' * | grep -v test/ | wc -l On Wed, Mar 25, 2020 at 3:34 PM Mike Miller wrote: > > I think we have come a long way removing any external types from the API, > for reasons