Can I create user defined stream processing function/api?

2017-03-06 Thread Wang LongTian
Dear folks,

Background: I'm leaning Kafka stream and want to use that in my product for 
real time streaming process with data from various sensors.

Question: 
1. Can I define my own processing function/api in Kafka stream except the 
predefined functions like groupby(), count() etc.?
2. If I could define my own function, could you please specify a example or 
introduce me a github project for example?

Thank u in advance!

Regards,
Long Tian

How to connect Modbus, DNP or IEC61850 data to Kafka

2016-12-03 Thread Wang LongTian
Dear all gurus,
I'm new to Kafka and I'm going to connect the real time data steaming from 
power system supervision and control devices to Kafka via different 
communication protocols for example Modbus, DNP or IEC61850 and next to Storm 
processing system. 
I'm wondering how can I get these data via Kafka and I don't know whether 
that's supported or not.

Any suggestion and hint are warmly welcomed!

Regards, 
Long Tian