Re: Standard way to get http POST request into a Kafka topic?

Hi, have a look for Rest Proxy component as part of the kafka eco system בתאריך יום ד׳, 28 באפר׳ 2021, 01:27, מאת Reed Villanueva ‏< villanuevar...@gmail.com>: > What is the best-practice/kafka way to get http(s) POST requests into a > Kafka topic (kafka v2.0.0 installed on a HDP cluster)? >

Standard way to get http POST request into a Kafka topic?

What is the best-practice/kafka way to get http(s) POST requests into a Kafka topic (kafka v2.0.0 installed on a HDP cluster)? Have never used kafka before and would like to know the best way that this should be done. Basically, we have a public URL that is going to receive requests from a

Re: JDBC Sink Connector: Counterpart to Dead Letter Queue to keep track of successfully processed records

Interesting idea (I have to think about it). On Tue, Apr 27, 2021 at 4:40 PM Ran Lupovich wrote: > Just a thought , what about jdbc source connector from the database to the > succsess topic? > > בתאריך יום ד׳, 28 באפר׳ 2021, 00:19, מאת Florian McKee ‏< > florian.mc...@gmail.com>: > > > Hi, > >

Re: JDBC Sink Connector: Counterpart to Dead Letter Queue to keep track of successfully processed records

Just a thought , what about jdbc source connector from the database to the succsess topic? בתאריך יום ד׳, 28 באפר׳ 2021, 00:19, מאת Florian McKee ‏< florian.mc...@gmail.com>: > Hi, > > > I want to ingest messages that are sent by 3rd parties into our system. > > > The ingestion process is as

JDBC Sink Connector: Counterpart to Dead Letter Queue to keep track of successfully processed records

Hi, I want to ingest messages that are sent by 3rd parties into our system. The ingestion process is as follows: - verify message content - forward invalid messages to ingestion_failure topic - persist valid messages in PostgreSQL - forward messages that have been persisted to