Re: ConsumeKafkaRecord won't pull new events from Kafka

2018-11-13 Thread Mike Thomsen
> > Do you use any Kafka headers in the processor? >> >> > >> >> > Also what happens if you try to replicate the behavior of >> ConsumeKafkaRecord like this. I don't know if you need the ConvertRecord >> but it might be needed to pick ou

Re: ConsumeKafkaRecord won't pull new events from Kafka

2018-11-13 Thread Mark Payne
what happens if you try to replicate the behavior of >> > ConsumeKafkaRecord like this. I don't know if you need the ConvertRecord >> > but it might be needed to pick out a schema name to use as Merge strategy. >> > ConsumeKafka -> (ConvertRecord) -> Merge Content >&g

Re: ConsumeKafkaRecord won't pull new events from Kafka

2018-11-13 Thread Mike Thomsen
; Also what happens if you try to replicate the behavior of > ConsumeKafkaRecord like this. I don't know if you need the ConvertRecord > but it might be needed to pick out a schema name to use as Merge strategy. > >> > ConsumeKafka -> (ConvertRecord) -> Merge Content > >> > &

Re: ConsumeKafkaRecord won't pull new events from Kafka

2018-11-13 Thread Viking K
in the ConvertRecord processor, and maybe it should be possible to grab out the error from there instead. /Viking From: Joe Witt Sent: Tuesday, November 13, 2018 5:32 PM To: users@nifi.apache.org Subject: Re: ConsumeKafkaRecord won't pull new events from Kafka

Re: ConsumeKafkaRecord won't pull new events from Kafka

2018-11-13 Thread Joe Witt
t know if you need the ConvertRecord >> > but it might be needed to pick out a schema name to use as Merge strategy. >> > ConsumeKafka -> (ConvertRecord) -> Merge Content >> > >> > /Viking >> > >> > From: Mike Thomsen

Re: ConsumeKafkaRecord won't pull new events from Kafka

2018-11-13 Thread Mike Thomsen
Merge strategy. > > ConsumeKafka -> (ConvertRecord) -> Merge Content > > > > /Viking > > ____ > > From: Mike Thomsen > > Sent: Tuesday, November 13, 2018 3:02 PM > > To: users@nifi.apache.org > > Subject: Re: ConsumeKafkaRecor

Re: ConsumeKafkaRecord won't pull new events from Kafka

2018-11-13 Thread Joe Witt
as Merge strategy. > ConsumeKafka -> (ConvertRecord) -> Merge Content > > /Viking > > From: Mike Thomsen > Sent: Tuesday, November 13, 2018 3:02 PM > To: users@nifi.apache.org > Subject: Re: ConsumeKafkaRecord won't pull new even

Re: ConsumeKafkaRecord won't pull new events from Kafka

2018-11-13 Thread Viking K
ent /Viking From: Mike Thomsen Sent: Tuesday, November 13, 2018 3:02 PM To: users@nifi.apache.org Subject: Re: ConsumeKafkaRecord won't pull new events from Kafka Closest thing I see to something that implies something might be awry is this in

Re: ConsumeKafkaRecord won't pull new events from Kafka

2018-11-13 Thread Mike Thomsen
Closest thing I see to something that implies something might be awry is this in nifi-app.log: javax.management.InstanceAlreadyExistsException: kafka.consumer:type=app-info,id=consumer-1 at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437) at

Re: ConsumeKafkaRecord won't pull new events from Kafka

2018-11-13 Thread Joe Witt
Mike, In previous versions that processor didn't have a parse.failure relationship I believe. In that case data would not be pulled when unable to parse it. In newer versions of the processor it has it. So check there first. Thanks On Tue, Nov 13, 2018 at 9:56 AM Mike Thomsen wrote: > > I

Re: ConsumeKafkaRecord won't pull new events from Kafka

2018-11-13 Thread Pierre Villard
Hey Mike, Anything in the logs? Pierre Le mar. 13 nov. 2018 à 15:56, Mike Thomsen a écrit : > I have an odd situation where I have ConsumeKafkaRecord and ConsumeKafka > pulling from the same topic under different consumer groups, but only the > latter will pull new events. I ran into a