Thanks for the response Pablo. We're currently using our own custom ParDo
connector for Cassandra (specialized to Scylla's sharding algorithm) that
has a 'readAll' type option and getting great results. Would you be up
for taking an outside contribution that refactors the current CassandraIO
con
Hi Vincent,
I think it makes sense to have some sort of `readAll` for CassandraIO that
can receive multiple queries, and execute each one of them. This would also
be consistent with other IOs that we have such as FileIOs.
I suspect that doing this may require rearchitecting the whole IO from a
Boun
Hello Pablo, thank you for the response, and apologies for the delay. I had
some work and also wanted to prove out what I was proposing with our own code
at my workplace.
Here is a small gist of what I'm proposing.
https://gist.github.com/vmarquez/204b8f44b1279fdbae97b40f8681bc25
I'm happy t
Hi Vincent!
Do you think you could add some code snippets / pseudocode as to what this
looks like? Feel free to do it on email, gist, google doc, etc?
Best
-P.
On Thu, Oct 3, 2019 at 4:16 PM Vincent Marquez
wrote:
> Currently the CassandraIO connector allows a user to specify a table, and
> the