Hello all, My use case involves reading rows containing user information off an external database, performing external api calls based on that information and writing the result to redis. My original idea was to read them off in batches of 4 rows using an ITridentSpout implementation but then I looked into IPartitionedTridentSpout and am wondering if that is the correct interface to use. If anyone has implemented a Trident spout that reads rows from a database i’d appreciate some guidance on which interface to use and what metadata could be used. I thought of using the table size and mod to get the offset to use sql LIMIT/OFFSET statements but I’m wondering if I’ll get into trouble when the txid number got big. Again, any help is appreciated.
Thanks! Dave Evident.io
