Re: Question about custom StreamJob/Factory

2018-01-28 Thread Tom Davis
As promised, here's the link to the repository: https://github.com/sonian/samza-kubernetes The section "Your Job Image" covers my remaining questions on the low-level API. We use Clojure on the backend, so I'm using that to sanity-check the example high-level app and will update the example if

Re: Question about custom StreamJob/Factory

2018-01-27 Thread Tom Davis
Thanks for the timely and thorough reply! Based on your explanation, it sounds like when using the high-level API I don't need to go through the JobRunner or `run-job.sh` at all -- is that correct? I can simply run as many instances of, e.g., `WikipediaZkLocalApplication` as I want and Samza will

Re: Question about custom StreamJob/Factory

2018-01-27 Thread Jagadish Venkatraman
+Yi Hi Tom, Thank you for your feedback on Samza's architecture. Pluggability has been a differentiator that has enabled us to support a wide range of use-cases - from stand-alone deployments to managed services, from streaming to batch inputs and integrations with various systems from Kafka,