Re: Installing Samza w/o internet connection

2015-06-25 Thread Milinda Pathirage
Hi Amos, Can you please let us know what do you mean by preparing Samza? Are you trying to build a Samza job package? Or Samza from sources? I don't think its possible to build from source (both Samza and a Samza job package) without internet in a new machine. One thing you can try is to build

Installing Samza w/o internet connection

2015-06-25 Thread Amos Mosseri
Hi, I'm trying to evaluate Samza, and I can't figure out how to install it on a computer w/o internet connection. I've already downloaded the samza source, but when I run the gradle build command, I get errors about resolving: * De.obqo.gradle:gradle-lesscss-plugin:1.0-1.3.3 *

monitoring best practices

2015-06-25 Thread Christopher Chamberlin
I see in the Samza metrics documentation that there are two basic ways to get metrics from Samza to a metrics repository: 1) write a custom MetricsReporter to push the metrics directly, perhaps using an ExecutorService or similar to perform batching, or 2) consume the metrics Kafka queue and push

Re: Hopping and tumbling windows in streaming SQL

2015-06-25 Thread Milinda Pathirage
Hi Julian, This is a great improvement over the previous hopping window. Thanks for thinking through this. I also like if we can introduce a TUMBLE function with more control over how we define tumbling window size. With the current FLOOR based model we have to perform date/time arithmetic to

Re: [SAMZA-690] Changelog topic creation should not be in the container code

2015-06-25 Thread Yi Pan
Hi, Robert, Thanks for digging into this. I am embedding my answers below: On Thu, Jun 25, 2015 at 7:40 AM, Robert Zuljevic r.zulje...@levi9.com wrote: 1. Is checkpoint topic referred to in the description coordinator stream/topic? In the master branch, checkpoint topic is

Re: Installing Samza w/o internet connection

2015-06-25 Thread Yi Pan
Hi, Amos, I assume that you are referring to preparing the build environment for Samza source code. As Milinda said, to set up the build environment, you will need a) an Internet connection to download required packages from Maven; b) a cached collection of required package on your local machine.

Re: [VOTE] Apache Samza 0.9.1 RC0

2015-06-25 Thread Yi Pan
Hi, all, I have been preparing for the new 0.9.1 RC1 and it is close to be done. I am going to cancel this VOTE, if no objections. Thanks! On Mon, Jun 22, 2015 at 5:41 PM, Yan Fang yanfang...@gmail.com wrote: Hi Yi, This only publishes the artifacts to the staging repository for testing.

Re: what does the utilization metric in SamzaContainerMetrics show?

2015-06-25 Thread Luis Fernando De Pombo
Hi Shadi, Thanks for asking. This metric tracks the utilization of the event loop https://samza.apache.org/learn/documentation/0.8/container/event-loop.html within a samza container, which uses a single thread, that is in charge of reading and writing messages, flushing metrics, checkpointing, and

Re: [VOTE] Apache Samza 0.9.1 RC0

2015-06-25 Thread Yan Fang
no objection from me. :) Thanks, Fang, Yan yanfang...@gmail.com On Thu, Jun 25, 2015 at 4:18 PM, Yi Pan nickpa...@gmail.com wrote: Hi, all, I have been preparing for the new 0.9.1 RC1 and it is close to be done. I am going to cancel this VOTE, if no objections. Thanks! On Mon, Jun 22,

what does the utilization metric in SamzaContainerMetrics show?

2015-06-25 Thread Shadi Noghabi
Hi, I was wondering what does this utilization metric in the SamzaContainerMetrics show? I am asking this sine in the code it is calculated as below: while (!shutdownNow) { val loopStartTime = clock(); process window commit val totalMs = clock() - loopStartTime

Re: Review Request 35492: SAMZA-701 : Hello Samza - Port docker setup from hadoop-common

2015-06-25 Thread Yan Fang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35492/#review89451 --- README.md (line 9)