Hi Alex,
could you please provide some links to where to start looking into that?
I'd like to better understand how exactly to implement a plugin and how
to use it afterwards.
Thanks!
Jan
On 2/3/24 17:39, Alexander Alten wrote:
Hi Jan,
Welcome!
Proxima looks good, and a plugin to Wayang would extend the capabilities into
streaming data analytics and realtime ML / AI, kind of. Looking forward to
contributions!
Best,
—Alex
—
Alexander Alten
PPMC Apache Wayang
alo...@apache.org
@apachewayang
On Feb 3, 2024, at 14:50, Jan Lukavský <je...@seznam.cz> wrote:
Hi Wayang community,
I got recently pointed out to your project and it got my attention. I'd like to
introduce myself - my name is Jan, I'm committer and PMC member of Apache Beam
project [1] and I also happen to work on a streaming-first platform which might
be a possible companion of Wayang. The platform is called Proxima [2] and can
be generally described as an abstraction layer on top of various storages
(streaming - e.g. Kafka, random access - e.g. Cassandra, HBase, Elasitc and
batch - e.g. HDFS, S3, GCS) providing unified access for applications n terms
of common data schema that is applied across these storage types. The platform
replicates data with eventual consistency (replicating from streaming storage -
the commit-log), optionally providing ACID guarantees. It seems to me it might
make sense to build a connector that could extend the capabilities of both
Wayang and Proxima. Would here be someone interesting in discussing this
further?
Best wishes to the project!
Jan
[1]
https://www.google.com/url?q=https://beam.apache.org/&source=gmail-imap&ust=1707573037000000&usg=AOvVaw2otR99KHMV-hq3-M4lbpxE
[2]
https://www.google.com/url?q=https://github.com/O2-Czech-Republic/proxima-platform&source=gmail-imap&ust=1707573037000000&usg=AOvVaw1yWtH0q0oF241UepthR_zt
