I don’t have a specific answer for you, but I do think this is a great use for streaming expressions!
I believe that with Solr you will need to monitor the process yourself, that there isn’t any support for restarting the daemon if it burps. I know in some commercial products that they take care of restarting the daemon for you. > On Sep 6, 2021, at 9:32 AM, Dan Rosher <rosh...@gmail.com> wrote: > > Hi, > > I was wondering if anyone had tried email alerts with streaming > expressions, and what their experience was if attempting this with say 12 > million emails / day? Traditionally this might have been done with a > database cursor iterator daily. > > I was thinking if something like the following pseudocode expression with > 'kafka' as a custom push expression: > > daemon(id="alertId", > runInterval="1000", > kafka( > kafka_topic, > alertId, > topic(email_alerts, > doc_collection, > q="email query", > fl="id, title, abstract", > id="alertId", > initialCheckpoint=0) > ) > > If you have done something like this 'where' would you typically run the > daemon, on replicas away from replicas running web queries? > > Many thanks in advance for any advice / suggestions, > > Dan _______________________ Eric Pugh | Founder & CEO | OpenSource Connections, LLC | 434.466.1467 | http://www.opensourceconnections.com <http://www.opensourceconnections.com/> | My Free/Busy <http://tinyurl.com/eric-cal> Co-Author: Apache Solr Enterprise Search Server, 3rd Ed <https://www.packtpub.com/big-data-and-business-intelligence/apache-solr-enterprise-search-server-third-edition-raw> This e-mail and all contents, including attachments, is considered to be Company Confidential unless explicitly stated otherwise, regardless of whether attachments are marked as such.
