Personally, I didn’t try to work with ScyllaDB from Beam, but looking at its wiki page:
"Scylla is an open-source distributed NoSQL data store. It was designed to be compatible with Apache Cassandra while achieving significantly higher throughputs and lower latencies. It supports the same protocols as Cassandra (CQL and Thrift) and the same file formats (SSTable)” and at sample Java application page [1], that shows how to connect to Scylla with Cassandra driver, I think it would make sense to try to use Beam CassandraIO [2] for that. [1] https://university.scylladb.com/courses/using-scylla-drivers/lessons/coding-with-java-part-1/ [2] https://beam.apache.org/releases/javadoc/2.28.0/org/apache/beam/sdk/io/cassandra/CassandraIO.html > On 10 Mar 2021, at 07:39, Shivam Singh <shivam.sin...@tokopedia.com> wrote: > > Hi, > > I have a use case to read data from Google BigQuery and write it to a table > in Scylla DB. > > I checked that there is no IO available for Scylla DB in beam for now. Please > guide me on how can this use case be build. > > Regards, > Shivam > > Disclaimer: > The information contained in this communication is intended solely for the > addressed individual or entity only. > If you are not the intended recipient, you are hereby notified that any > disclosure, copying, distribution or taking any action in reliance on the > contents of this information is strictly prohibited and may be unlawful. > If you have received this communication in error, please notify us > immediately by responding to this email or contact us at the address > mentioned above.
