Hi Wayang community,
I got recently pointed out to your project and it got my attention. I'd
like to introduce myself - my name is Jan, I'm committer and PMC member
of Apache Beam project [1] and I also happen to work on a
streaming-first platform which might be a possible companion of Wayang.
The platform is called Proxima [2] and can be generally described as an
abstraction layer on top of various storages (streaming - e.g. Kafka,
random access - e.g. Cassandra, HBase, Elasitc and batch - e.g. HDFS,
S3, GCS) providing unified access for applications n terms of common
data schema that is applied across these storage types. The platform
replicates data with eventual consistency (replicating from streaming
storage - the commit-log), optionally providing ACID guarantees. It
seems to me it might make sense to build a connector that could extend
the capabilities of both Wayang and Proxima. Would here be someone
interesting in discussing this further?
Best wishes to the project!
Jan
[1] https://beam.apache.org/
[2] https://github.com/O2-Czech-Republic/proxima-platform
