[GitHub] samza pull request #347: SAMZA-1478; Delete unneeded data from intermediate ...

2017-10-31 Thread lindong28
GitHub user lindong28 opened a pull request: https://github.com/apache/samza/pull/347 SAMZA-1478; Delete unneeded data from intermediate Kafka topic on offset commit You can merge this pull request into a Git repository by running: $ git pull

[GitHub] samza pull request #346: Admin GetPartitionsCount should return count and no...

2017-10-31 Thread sborya
GitHub user sborya opened a pull request: https://github.com/apache/samza/pull/346 Admin GetPartitionsCount should return count and not fake SamzaPartitionsMetadata You can merge this pull request into a Git repository by running: $ git pull https://github.com/sborya/samza

Re: Samza questions (downtime during deployment and num partition per task)

2017-10-31 Thread xinyu liu
Hi, Tony, For your questions: 1) Having a hot-standby job instance for fail-over may introduce certain operational complications. For example, if they produce to the same output, then both will be running in a short period of time, which might lead to duplicates in output. If the jobs has local

[GitHub] samza pull request #345: SAMZA-1477: Fix issues found by BEAM tests

2017-10-31 Thread xinyuiscool
GitHub user xinyuiscool opened a pull request: https://github.com/apache/samza/pull/345 SAMZA-1477: Fix issues found by BEAM tests A bunch of issues were found by BEAM tests, which includes: 1) WatermarkFunction needs to be able to return output after processWatermark()

Re: Exit code 248 from YARN and InterruptedException

2017-10-31 Thread Jagadish Venkatraman
Hi Xiaochuan, Is there any exception in your custom SystemConsumer? Or, are you saying that your consumer is being interrupted externally? The entire log will be helpful. Thanks, Jagdish On Mon, Oct 30, 2017 at 9:14 AM, XiaoChuan Yu wrote: > Hi, > > I'm trying to debug