[GitHub] samza pull request #111: SAMZA-1189: Fix file system closed issue on hdfs sy...

2017-04-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/samza/pull/111 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] samza pull request #111: SAMZA-1189: Fix file system closed issue on hdfs sy...

2017-04-04 Thread jmakes
GitHub user jmakes opened a pull request: https://github.com/apache/samza/pull/111 SAMZA-1189: Fix file system closed issue on hdfs system producer You can merge this pull request into a Git repository by running: $ git pull https://github.com/jmakes/samza samza-1189 Alternat

[GitHub] samza pull request #110: SAMZA-1178: Generate JSON from StreamPlan

2017-04-04 Thread xinyuiscool
GitHub user xinyuiscool opened a pull request: https://github.com/apache/samza/pull/110 SAMZA-1178: Generate JSON from StreamPlan As the first step to visualize the StreamGraph/Plan, this patch generates a json representation of it. For the example StreamGraph in TestPlanJsonGenera

Re: Messages lost after broker failure

2017-04-04 Thread Jagadish Venkatraman
>> All this is leading us to conclusion that Samza's consumers are somehow not aware of all of the partitions We have had a number of broker failures at LinkedIn, and have not run into data loss issues due to consumers being unaware of partitions. You can use the metrics emitted at a per-partition

Re: Samza 0.12.0 artifact for scala 2.10 in maven central

2017-04-04 Thread Maksim Logvinenko
Hi Jagadish, Cool, thanks a lot! Best regards, Maxim Logvinenko On 4 April 2017 at 03:33:57, Jagadish Venkatraman (jagadish1...@gmail.com) wrote: Hi Maxim, I generated, and published the Scala 2.10 artifacts to the staging artifactory at : https://repository.apache.org/content/repositories/or

Messages lost after broker failure

2017-04-04 Thread Aleksandar Bircakovic
Hi everyone, my team is building real-time system using Samza (version 0.11.0) and we are facing some issues with data loss so we would like to hear your thoughts. Due to using some additional tools for monitoring and alerting we exceeded number of allowed open files so TooManyOpenFiles exceptio