Adding dev@ mailing list... There is definitely a performance hit. But it shouldn't be as drastic as you describe.
Can you share some of your environment characteristics? I've been looking at the Apache Arrow project (full disclosure: I'm a PMC member) as a means for improved performance (it essentially would remove the performance hit for serialize/deserialize operations). This is particularly relevant to multi-lang, but could also apply to same-machine inter-worker communication. At this point I don't feel Arrow is at a production level maturity, but is getting close. I definitely feel it's worth exploring at PoC level. -Taylor > On May 12, 2017, at 6:56 PM, Mauro Giusti <mau...@microsoft.com> wrote: > > Hi – > We are using multi-lang to pass data between storm and mono – > > We observe a 6x time increase when messages go from spout to bolt if the bolt > is in mono vs. being in Java – > > Java can process 10,000 records in 0.7 seconds, while mono requires 4.5 > seconds. > The mono bolt was an empty one created with Storm.Net.Adapter library > > This is on a single machine topology – we are still in dev phase and using > this solution for now - > > Is this expected? > Should we try to minimize multi-lang and inter-process or is this a problem > with my specific scenario (mono and/or single machine) ? > > Thank you – > Mauro.
