Structured Streaming together with Cassandra Queries

2018-09-22 Thread Martin Engen
Hello, I have a case where I am continuously getting a bunch sensor-data which is being stored into a Cassandra table (through Kafka). Every week or so, I want to manually enter additional data into the system - and I want this to trigger some calculations merging the manual entered data, and

Re: Structured Streaming, Reading and Updating a variable

2018-05-16 Thread Martin Engen
util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) Any ideas about how to handle this error? Thanks, Martin Engen From: Lalwani, Jayesh <jayesh.lalw...@capitalone.com> Sent: Tu

Structured Streaming, Reading and Updating a variable

2018-05-15 Thread Martin Engen
Hello, I'm working with Structured Streaming, and I need a method of keeping a running average based on last 24hours of data. To help with this, I can use Exponential Smoothing, which means I really only need to store 1 value from a previous calculation into the new, and update this variable