I think if you want to ensure that writes happen in the same order that they come in, you'll need to make your pipeline is sequential/serial in nature (IE no parallelism) which may defeat the purpose of using storm. You may be able to be a bit clever and use some other piece of information as the Primary key for the record in your DB such that no matter what order they get inserted, they're sorted correctly by that Pk, but its difficult to say without knowing more about the data.
On Sat, Jan 9, 2016 at 2:24 PM, pradeep s <[email protected]> wrote: > Hi , > I have a requirement to read CDC messages which are landed in AWS SQS and > give the rwas message to S3 and do some processing and write to maria db. > I have done a sample spout which reads messages from SQS and two bolts > which are for S3 and DB. I am using BaseRich Spout and bolt and doing > reliable emit. > > I have a doubt on how the order of the message is guranteed when i write > the records to database. I want to write in the same order in which the > records are read from queue. > Can someone give an example topology code where the order is guranteed > while using storm processing. > Regards > Pradeep S >
