[GitHub] samza pull request #546: Minor: KafkaConfig should treat empty changelog nam...

2018-06-05 Thread prateekm
GitHub user prateekm opened a pull request: https://github.com/apache/samza/pull/546 Minor: KafkaConfig should treat empty changelog name as no changelog. If a store changelog stream name is empty, treat is as a non-changelogged store instead of throwing an exception. You can

[GitHub] samza pull request #545: SAMZA-1740: Moving SamzaSqlRelRecord to samza-api a...

2018-06-05 Thread atoomula
GitHub user atoomula opened a pull request: https://github.com/apache/samza/pull/545 SAMZA-1740: Moving SamzaSqlRelRecord to samza-api as it is needed to be used in UDFs Please see description in the ticket. You can merge this pull request into a Git repository by running: $

Re: MessageCollector and WindowableTask

2018-06-05 Thread Jagadish Venkatraman
Hey Jeremiah, Here's a standard pattern that Samza users in the community have adopted. Configure your job to consume from your input-topic that contains a stream of requests. In your process() call: - If you need to retry your request, store it for later processing in a RocksDB store

[GitHub] samza pull request #544: SAMZA-929 : Set initialDelay in tokenRenewExecutor ...

2018-06-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/samza/pull/544 ---

Re: MessageCollector and WindowableTask

2018-06-05 Thread Jeremiah Adams
I was hoping I could use Windowing to process a topic every n-seconds for some lengthy retry logic. E.g. some tasks can be retried n-times every m-seconds if they fail. Failed attempts are re-queued for n-attempts before being considered a real failure. e.g. POSTing to an endpoint fails due

Re: MessageCollector and WindowableTask

2018-06-05 Thread Jagadish Venkatraman
Hey Jeremiah, >> Please only use that MessageCollector object for sending messages, and don't use it outside of the call to window(). Why MessageCollector should not be used outside the call to window() in a WindowableTask? The collector and coordinator instances are expected to be used within a

MessageCollector and WindowableTask

2018-06-05 Thread Jeremiah Adams
>From th?e docs: "If you need to send messages to output streams, you can use the MessageCollector object passed to the window() method. Please only use that MessageCollector object for

[GitHub] samza pull request #544: SAMZA-929 : Set initialDelay in tokenRenewExecutor ...

2018-06-05 Thread apoorva121
GitHub user apoorva121 opened a pull request: https://github.com/apache/samza/pull/544 SAMZA-929 : Set initialDelay in tokenRenewExecutor schedule to 0 Changed initialDelay in tokenRenewExecutor scheduler to 0 so that it can re-login using the keytab as soon as the application