Hi, I was wondering if anyone had tried email alerts with streaming expressions, and what their experience was if attempting this with say 12 million emails / day? Traditionally this might have been done with a database cursor iterator daily.
I was thinking if something like the following pseudocode expression with 'kafka' as a custom push expression: daemon(id="alertId", runInterval="1000", kafka( kafka_topic, alertId, topic(email_alerts, doc_collection, q="email query", fl="id, title, abstract", id="alertId", initialCheckpoint=0) ) If you have done something like this 'where' would you typically run the daemon, on replicas away from replicas running web queries? Many thanks in advance for any advice / suggestions, Dan