Re: Feature addition to java CassandraIO connector

2019-11-07 Thread Vincent Marquez
Thanks for the response Pablo. We're currently using our own custom ParDo connector for Cassandra (specialized to Scylla's sharding algorithm) that has a 'readAll' type option and getting great results. Would you be up for taking an outside contribution that refactors the current CassandraIO con

Re: Feature addition to java CassandraIO connector

2019-10-16 Thread Pablo Estrada
Hi Vincent, I think it makes sense to have some sort of `readAll` for CassandraIO that can receive multiple queries, and execute each one of them. This would also be consistent with other IOs that we have such as FileIOs. I suspect that doing this may require rearchitecting the whole IO from a Boun

Re: Feature addition to java CassandraIO connector

2019-10-14 Thread Vincent Marquez
Hello Pablo, thank you for the response, and apologies for the delay. I had some work and also wanted to prove out what I was proposing with our own code at my workplace. Here is a small gist of what I'm proposing. https://gist.github.com/vmarquez/204b8f44b1279fdbae97b40f8681bc25 I'm happy t

Re: Feature addition to java CassandraIO connector

2019-10-04 Thread Pablo Estrada
Hi Vincent! Do you think you could add some code snippets / pseudocode as to what this looks like? Feel free to do it on email, gist, google doc, etc? Best -P. On Thu, Oct 3, 2019 at 4:16 PM Vincent Marquez wrote: > Currently the CassandraIO connector allows a user to specify a table, and > the