Hi Wyatt -- welcome! If you'd like to write to a PCollection to Apache Accumulo's key/value store, writing an new IO connector would be the best path forward. Accumulo has somewhat similar concepts as BigTable, so you can use the existing BigTableIO as an inspiration.
You are thinking it exactly right -- a connector written in Beam would be runner-independent, and thus can run anywhere. I'm not aware that anybody has started on this one yet -- feel free to file a JIRA to have a place to coordinate if someone else is interested. And, if you get stuck or need help in any way, there are plenty of people on the Beam mailing lists happy to help! Once again, welcome! Davor On Wed, Jan 11, 2017 at 6:04 PM, Wyatt Frelot <[email protected]> wrote: > All, > > Being new to Apache Beam...I want to ensure that I approach things the > "right way". > > My goal: > > I want to be able to write a PCollection to Apache Accumulo. Something > like this: > PCollection.apply(AccumuloIO.Write.to("AccumuloTable")); > > While I am sure I can create a custom class to do so, it has me thinking > about identifying the best way forward. > > I want to use the Apex Runner to run my applications. Apex has Malhar > libraries that are already written that would be really useful. But, I > don't think that is the point. The goal is to develop IO Connectors that > are able to be applied to any runner. Am I thinking about his correctly? > > Is there any work being done to develop an IO Connector for Apache > Accumulo? > > Wyatt > > > wa >
