Re: Is it possible to choose Kafa version with StormKafka from Storm 1.0.2 ?

Hi Alexandre, My recollection from trying this when 0.10 was released is that it is possible, but some small code changes are necessary. If you're comfortable building Storm from source, updating the kafka version in the appropriate poms and compiling would show you what needs to be updated. On

Re: storm-hdfs bolt generate avro files issue

Hello -- an Avro error like that usually indicates a mismatch between your record and the schema the bolt is expecting. Can you share your schema and the record giving this error? On Fri, Nov 25, 2016 at 5:08 PM Yi Jiang wrote: > Hello, Guys > > I am recently using the

Re: Testing serializers with multiple workers

Hit send too soon... that really is the option :-) On Fri, Nov 18, 2016 at 9:03 AM Aaron Niskodé-Dossett <doss...@gmail.com> wrote: > topology.testing.always.try.serialize = true > > On Fri, Nov 18, 2016 at 8:57 AM Kristopher Kane <kkane.l...@gmail.com> > wrote:

Re: Testing serializers with multiple workers

topology.testing.always.try.serialize = true On Fri, Nov 18, 2016 at 8:57 AM Kristopher Kane wrote: > Does anyone have any techniques for testing serializers that would only > surface when the serializer is uses in a multi-worker topology? > > Kris >

Re: ESBolt error

Hi Aaron, > > Thanks for the response. I am actually using the bolt you linked me to. > Any ideas? > > On Thu, Nov 3, 2016 at 7:36 PM, Aaron Niskodé-Dossett <doss...@gmail.com> > wrote: > > Hi Mostafa Gomaa -- Unfortunately Storm's bolt does not support Elastic &g

Re: ESBolt error

Hi Mostafa Gomaa -- Unfortunately Storm's bolt does not support Elastic 2.X. There is a PR to add this support, which I need to put some work into. In the meantime, you could try elastic's bolt ( https://www.elastic.co/guide/en/elasticsearch/hadoop/current/storm.html). Thanks, Aaron On Thu,

Re: HIveBolt

If you are using a current version of the HiveBolt then those tuples will not be acknowledged and will eventually be retried. On Tue, Oct 25, 2016 at 7:22 AM Davorin Vukelić < davo...@crossing-technologies.com> wrote: > HI, > > can someone explain to me how to adjust HiveBolt? I use storm-hive

Re: Increasing worker parallelism decreases throughput and increases tuple timeout

iler but did not give it the attention it deserved. > > On Tue, Sep 6, 2016 at 9:39 AM, Aaron Niskodé-Dossett <doss...@gmail.com> > wrote: > >> Hi Kris, >> >> One possibility is that the Serializer isn't actually caching the schema >> <-> id mappi

Re: Increasing worker parallelism decreases throughput and increases tuple timeout

Hi Kris, One possibility is that the Serializer isn't actually caching the schema <-> id mappings and is hitting the schema registry every time. The call to register() in getFingerprint() [1] in particular can be a finicky since the cache is ultimately in an IDENTITY hash map, not a regular old

Re: Storm HDFS multiple writers

es with storm-hdfs because of > speed mismatch ? > > Has storm community suggest something else for the cold storage of the > streaming data? > > On Tue, Jun 28, 2016 at 5:48 PM, Aaron Niskodé-Dossett <doss...@gmail.com> > wrote: > >> No, files are not merged. I

Re: Storm HDFS multiple writers

No, files are not merged. In general you specify a directory and a file naming convention but each writer writes to its own file. On Tue, Jun 28, 2016 at 7:45 PM Jakes John wrote: > Hi, > I would like to know how does the storm HDFS bolt works? As far as > I