Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

tion, will they see any performance impact? docs/learn/documentation/versioned/jobs/configuration-table.html (line 368) <https://reviews.apache.org/r/50174/#comment213389> is this property used only if job.container.single.thread.mode == true ? - Navina Ramesh On July 27, 2016, 11:05 p.m.,

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

an example of AsyncStreamTask to samza's hello-world will give a quick idea to the user on when to use it and how to use it. This can be augmented in a tutorial page, similar to the one Jake provided for samza-rest api. Thanks! - Navina Ramesh On July 27, 2016, 11:05 p.m., Xinyu Liu wrote

Re: [DISCUSS] End of Stream Feature in Samza

Hi Jagadish, Thanks for sharing the design with the community. I have a couple of questions that were not very clear from the design document. 1. Under mechanism for indicating the end-of-stream to Samza, you mention "The offset in the partition that the message was received from. If this is the

Re: Review Request 51516: SAMZA-702: Document the significance of all the different metrics emitted by Samza out of the box

e 247) <https://reviews.apache.org/r/51516/#comment214698> I actually don't see any difference between "send-calls" and "messages-sent". Both are technically the same. We should consider removing one of them. At least, deprecating one of them in the current version.

Re: Review Request 51516: SAMZA-702: Document the significance of all the different metrics emitted by Samza out of the box

cular system stream partition docs/learn/documentation/versioned/container/metrics-table.html (line 379) <https://reviews.apache.org/r/51516/#comment214705> nit: Average time spent polling all underlying systems for new messages (in nanoseconds) - Navina Ramesh On Aug. 30, 2016, 7:

Re: Review Request 51516: SAMZA-702: Document the significance of all the different metrics emitted by Samza out of the box

container/metrics-table.html (line 795) <https://reviews.apache.org/r/51516/#comment214711> did you mean per-system here? - Navina Ramesh On Aug. 30, 2016, 7:36 a.m., Branislav Cogic wrote: > > --- > This is an automatically ge

Re: Review Request 51630: SAMZA-1007: Pass job config from factory to grouper

thanks! - Navina Ramesh On Sept. 5, 2016, 6:05 p.m., Neil Fordyce wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.

Re: Periodic cleanup of unused local stores

Hi Santhosh, Thanks for picking SAMZA-656. This is long overdue and will help make our host-affinity based solution more robust. I have a couple of thoughts on your design proposal. 1. It is always very useful to provide more context to the reader, esp. in explaining what the different terms

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

f the file represent the file length ? (in suffix string) Or did you just add it for testing? - Navina Ramesh On Aug. 29, 2016, 5:27 p.m., Hai Lu wrote: > > --- > This is a

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

<https://reviews.apache.org/r/51142/#comment214572> If it is not implemented, I suggest removing it and simply adding a comment that another potential readertype could be "PLAIN" text - Navin

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

> On Aug. 25, 2016, 12:30 a.m., Navina Ramesh wrote: > > docs/learn/documentation/versioned/container/event-loop.md, line 24 > > <https://reviews.apache.org/r/50174/diff/2/?file=1455860#file1455860line24> > > > > There is no sharing of task state in Samza. E

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

> On Aug. 25, 2016, 12:30 a.m., Navina Ramesh wrote: > > docs/learn/documentation/versioned/container/event-loop.md, line 49 > > <https://reviews.apache.org/r/50174/diff/2/?file=1455860#file1455860line49> > > > > Does anything change with resp

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

> On Aug. 25, 2016, 12:30 a.m., Navina Ramesh wrote: > > docs/learn/documentation/versioned/jobs/configuration-table.html, line 360 > > <https://reviews.apache.org/r/50174/diff/2/?file=1455861#file1455861line360> > > > > Isn't there a performance impact if

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

> On Aug. 25, 2016, 12:31 a.m., Navina Ramesh wrote: > > Not that I intend to give you more work. However, adding an example of > > AsyncStreamTask to samza's hello-world will give a quick idea to the user > > on when to use it and how to use it. This can be augmented in

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

ict conventions for config names listed anywhere. Since we use period as a delimiter to distinguish configs belonging to a namespace, I think we should try to avoid using the same in the actual config part. For example, job.container.single.thread.mode can be job.container.single-thread-m

Re: Review Request 51252: SAMZA-1004: Fix some logging and javadoc issues for AsyncStreamTask

2016, 10:01 p.m., Xinyu Liu wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/51252/ > --- > > (Updated Aug. 30, 2016, 10:01 p.m.) > > > Review r

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

> On Aug. 31, 2016, 12:54 a.m., Navina Ramesh wrote: > > docs/learn/documentation/versioned/jobs/configuration-table.html, line 357 > > <https://reviews.apache.org/r/50174/diff/3/?file=1488352#file1488352line357> > > > > Is it too late to comment on the conf

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

-- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/50174/ > --- > > (Updated Sept. 7, 2016, 5:16 p.m.) > > > Review request for samza, Chris Petti

Re: Question about Samza Metrcis

Hi ShuQi, Auto-creation of streams depends on your Kafka server configuration. In case of coordinator stream and checkpoint stream, samza explicitly creates a stream with 1 partition before publishing to it. This doesn't apply for metrics. So, if auto-creation is turned off in kafka server, then

Re: Review Request 51726: SAMZA-1005: Refactor class instantiation code to a helper class.

of the occurrences of Class loaders :) Thanks for the patch! - Navina Ramesh On Sept. 8, 2016, 12:44 p.m., Branislav Cogic wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache

Re: Review Request 51630: SAMZA-1007: Pass job config from factory to grouper

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51630/#review148404 --- Ship it! Ship It! - Navina Ramesh On Sept. 6, 2016, 8:41

Re: Issue with consuming non-existent topics in 0.10.1

Hi Tommy, Yi and I discussed about it and initially, we thought it could have something to do with the topic auto-creation setting on your Kafka server. Is it enabled or disabled in your case? I kind of suspect that the request timeout is insufficient. However, we do have retries on Samza to

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

/#review150883 --- On Sept. 28, 2016, 9:57 p.m., Hai Lu wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/51142/ > ------- > &g

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

-- > > (Updated Sept. 28, 2016, 9:57 p.m.) > > > Review request for samza, Yi Pan (Data Infrastructure) and Navina Ramesh. > > > Bugs: SAMZA-967 > https://issues.apache.org/jira/browse/SAMZA-967 > > > Reposito

Re: Review Request 52066: change warn about loopback address to a debug

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/52066/#review149877 --- Ship it! Ship It! - Navina Ramesh On Sept. 19, 2016, 8:55

Re: Question about Samza Metrics

Hi Shuqi, It depends on the type of metric you are looking for. Most counters and gauges are cumulative. Timer is the only metrics that works within a sliding window (if I am not mistaken). What usecase are you trying to solve? Thanks! Navina On Mon, Sep 12, 2016 at 11:50 PM, 舒琦

Re: Issue with consuming non-existent topics in 0.10.1

ker has finished creating the topic and returns the correct partition > metadata. The optimized path introduced by the SAMZA-971 fix goes into > KafkaSystemAdmin.getSystemStreamPartitionCounts() which does not check > this errorCode, and simply returns an empty set of partitions. Does that > m

Re: Review Request 50154: SAMZA-976 Samza REST Documentation

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/50154/#review145962 --- Ship it! Ship It! - Navina Ramesh On Aug. 17, 2016, 1:58

Re: Review Request 50154: SAMZA-976 Samza REST Documentation

> On Aug. 16, 2016, 12:50 a.m., Navina Ramesh wrote: > > docs/learn/tutorials/versioned/samza-rest-getting-started.md, line 73 > > <https://reviews.apache.org/r/50154/diff/6/?file=1458034#file1458034line73> > > > > Should change run-samza-rest-servi

Re: Review Request 51047: SAMZA-1000 Fix hello-samza documentation to not use latest branch by default

On Aug. 15, 2016, 6:18 p.m., Jake Maes wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/51047/ > --

Re: Review Request 50151: SAMZA-975 Initial Samza REST Implementation

... return (T) instance; } } ``` - Navina Ramesh On Aug. 17, 2016, 3:35 p.m., Jake Maes wrote: > > --- > This is an automatically generated e-mail. To reply, visit:

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

> > (Updated Sept. 20, 2016, 11:22 p.m.) > > > Review request for samza, Chris Pettitt, Yi Pan (Data Infrastructure), and > Navina Ramesh. > > > Bugs: SAMZA-967 > https://issues.apache.org/jira/browse/SAMZA-967 > > > Re

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/51142/ > --- > > (Updated Sept. 20, 2016, 11:22 p.m.) > > > Review request for samza, Chris Pettitt, Yi Pan (Data Infrastructure),

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

h (line 27) <https://reviews.apache.org/r/51142/#comment218688> If we want to use this only for the azkaban runner, we should perhaps rename the file as run-job-for-azkaban.sh or something on those lines. - Navina Ramesh On Sept. 20, 2016,

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

lemented the bucketized locking as a > > built-in method already: > > http://www.tutorialspoint.com/guava/guava_caching_utilities.htm > > Navina Ramesh wrote: > What was the resolution here? Was there any change to the IO pattern to > use caching? > > Hai Lu wrot

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

the set of compatible APIs! So, I > guess that we just enforce avro-1.4 when compiling samza-hdfs module? I > remember that I tried last time and got a build failure in samza-hdfs w/ > AvroDataFileHdfsWriter in samza-li build. I am curious how you made it work. > > Navin

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

gt; ----------- > > (Updated Sept. 20, 2016, 11:22 p.m.) > > > Review request for samza, Chris Pettitt, Yi Pan (Data Infrastructure), and > Navina Ramesh. > > > Bugs: SAMZA-967 > https://issues.apache.org/jira/brows

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

n samza-hdfs and samza-kafka? It seems to have been introduced by the HdfsSystemProducer. Can we please fix it forward? Or as Yi suggested, please create a JIRA and add a TODO comment here referring to the JIRA Thanks! - Navina Ramesh On Sept. 20, 20

Re: Review Request 52168: Tasks endpoint to list the complete details of all tasks related to a job

ting an instance of ConfigFactory. Why not use the ClassLoaderHelper directly whereever this is used? - Navina Ramesh On Oct. 24, 2016, 10 p.m., Shanthoosh Venkataraman wrote: > > --- > This is an automatically generated e-mail

Re: SAMZA-469 - scala 2.11 / move to java?

Hi Thunder, Sorry about the late response. I was refreshing my memory of SAMZA-469 :) Is there something preventing this from getting into a release? > Seems to me like the main roadblock on upgrading to scala 2.11 was related to JDK6. We have already moved away from JDK6 and JDK7. So, I don't

Re: Review Request 52960: SAMZA-1029: Prepare release candidate for 0.11.0

(line 51) <https://reviews.apache.org/r/52960/#comment06> Shouldn't this be 0.11.1-SNAPSHOT as well? - Navina Ramesh On Oct. 17, 2016, 11:45 p.m., Xinyu Liu wrote: > > --- > This is an automatically generated e-mail.

Re: Review Request 52962: SAMZA-1029: Prepare release candidate for 0.11.0

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/52962/#review153001 --- Ship it! Ship It! - Navina Ramesh On Oct. 18, 2016

Re: SAMZA-469 - scala 2.11 / move to java?

. > > Thanks! > Thunder > > > -Original Message- > From: Navina Ramesh [mailto:nram...@linkedin.com.INVALID] > Sent: Thursday, November 10, 2016 2:19 PM > To: dev@samza.apache.org > Subject: Re: SAMZA-469 - scala 2.11 / move to java? > > Hi Thunder, > Sorry

Re: [VOTE] Apache Samza 0.11.0 RC2

Validated MD5 and build. Ran check-all and integration test on Mac. +1 (binding) Thanks! Navina On Tue, Oct 11, 2016 at 1:16 PM, Yi Pan wrote: > Build, validated MD5, test w/ integration tests and passed. Thanks! > > +1 (binding) > > On Mon, Oct 10, 2016 at 4:07 PM, xinyu

Re: [DISCUSS] Samza 0.12.0 release

+1 Navina On Fri, Dec 23, 2016 at 2:53 PM, xinyu liu wrote: > +1 on the new release. > > Thanks, > Xinyu > > On Fri, Dec 23, 2016 at 2:50 PM, Yi Pan wrote: > > > Yep! Thanks for pointing it out! @Shanthoosh, can you update the list > > accordingly?

Re: [VOTE] SEP-1: Semantics of ProcessorId in Samza

ing to which processorId we are getting. > > Otherwise, the proposal looks good. > > -Yi > > On Wed, Mar 29, 2017 at 7:57 PM, Navina Ramesh > <nram...@linkedin.com.invalid > > wrote: > > > Good to hear from you, Yan. Thanks! :) > > > > On Wed, Mar 29,

Re: Steps to Upgrading Samza (0.9 to 0.12)

Hi everyone, Apologize for re-chiming in late on this issue. > I'm not sure I agree with the policy (removing migration code and wanting people to upgrade seem at odds to me), but minimally I think we should not assume people are upgrading to each new Samza version. I agree that we should not

Re: [VOTE] SEP-1: Semantics of ProcessorId in Samza

st, > > Renato M. > > 2017-03-30 20:45 GMT+02:00 Navina Ramesh <nram...@linkedin.com.invalid>: > > > Hi Yi, > > Good question. Three reasons: > > > > 1. In SAMZA-881, we came up with a set of responsibilities for the > > JobCoordinator. One

Re: [VOTE] SEP-1: Semantics of ProcessorId in Samza

> +1 on my side. Very happy to see this proposal. This is a blocker for > > integrating fluent API with StreamProcessor, and hopefully we can get it > > resolved soon :). > > > > Thanks, > > Xinyu > > > > On Tue, Mar 28, 2017 at 11:28 AM, Navina R

Re: [VOTE] SEP-1: Semantics of ProcessorId in Samza

7 at 2:00 PM, xinyu liu <xinyuliu...@gmail.com> > > wrote: > > > > > > > +1 on my side. Very happy to see this proposal. This is a blocker for > > > > integrating fluent API with StreamProcessor, and hopefully we can get > > it > > > > res

Re: [DISCUSS] Support Scala 2.12

Thanks for creating the DISCUSS email! This is good. It's a good idea to update to 2.12 since it looks like we are fully backward compatible with older versions. +1 from me. Cheers! Navina On Fri, Mar 17, 2017 at 1:34 PM, Jagadish Venkatraman < jagadish1...@gmail.com> wrote: > Thanks for

Re: [DISCUSS] SEP-1: Semantics of ProcessorId in Samza

Navina On Tue, Mar 21, 2017 at 10:33 AM, Navina Ramesh (Apache) <nav...@apache.org> wrote: > Hi Jagadish, > Thanks for the suggestion. You are right in that it should be the > responsibility of the JobCoordinator to assign identifiers. > > > 'm only wondering if this log

Re: [DISCUSS] SAMZA-1141 - Apache Samza Development Process Improvements

oposal as the first > SEP (like SEP-0), so it serves an example of how it will look like in > practice? > > Xinyu > > On Tue, Mar 14, 2017 at 3:34 PM, Navina Ramesh > <nram...@linkedin.com.invalid > > wrote: > > > Just to clarify: The proposal for code and design pr

Re: [DISCUSS] SAMZA-1141 - Apache Samza Development Process Improvements

Venkatraman < jagadish1...@gmail.com> wrote: > Thanks for writing this up. > > I'm +1 on this proposal. > > > > On Tue, Mar 14, 2017 at 3:15 PM, Navina Ramesh (Apache) <nav...@apache.org > > > wrote: > > > Hi everyone, > > > > We switch

Re: [DISCUSS] SEP-1: Semantics of ProcessorId in Samza

e client to use. > > I am working on the ApplicationRunner SEP right now. Will send out the > discussion email once I am done. > > Thanks, > Xinyu > > On Thu, Mar 16, 2017 at 4:50 PM, Navina Ramesh (Apache) <nav...@apache.org > > > wrote: > > > > One m

Re: Samza Logo designs

Hi Nacho, I rated on the designcrowd website directly. In terms of feedback: 1. I like the concept of using a butterfly to indicate "metamorphosis". However, a lot of the designs there look like a bow-tie :) 2. I think we should stick with a red theme for the name. Sorry about the late response.

Re: [VOTE] Samza Logo

d. But feel free to leave comments here, > maybe you can try to persuade people or argue for your favorite. :-) > > Nacho > > On Fri, Apr 14, 2017 at 2:31 PM, Navina Ramesh > <nram...@linkedin.com.invalid> wrote: > > Hi Nacho, > > Do you want us to vote on this ma

Re: [DISCUSS] SEP-2: ApplicationRunner Design

Hey Yi, Thanks for lot for your work on this document. I know it must have been crazy trying to put-together everything in a single doc :) Here are my comments. Sorry about the delay :( 1. It will be useful to set some background for the benefit of the community members who haven't been

Re: [VOTE] Samza Logo

5 star > > > ones, you're missing your vote on the ones you don't like. > > > > > > So, once we close, we'll see how people voted. > > > > > > Nacho > > > > > > > > > On Fri, Apr 14, 2017 at 9:21 PM, Yi Pan <nickpa...@

Re: [VOTE] Samza Logo

Hi Nacho, Do you want us to vote on this mail thread or directly at design crowd? Thanks! Navina On Fri, Apr 14, 2017 at 2:19 PM, Ignacio Solis wrote: > Hi folks. > > After some feedback and culling, we are down to 4 candidates. Please > vote on your favorite designs. We will

Re: [Discuss] Samza 0.13.1 release

Fred, Thanks for starting the release process. I am unable to open the link you have provided, though. It opens the JIRA SAMZA-1165, instead of the entire list of 0.13.1 bug fixes. Can you please re-check? Navina On 8/11/17, 6:13 PM, "ignacio.so...@gmail.com on behalf of Ignacio Solis"

Re: [VOTE] Apache Samza 0.13.1 RC0

Ran check-all on Mac. Build looks good. +1 (binding) Thanks! Navina From: Fred Haifeng Ji Sent: Tuesday, August 22, 2017 11:19 AM To: dev@samza.apache.org Subject: Re: [VOTE] Apache Samza 0.13.1 RC0 [You don't often get email from

Re: [VOTE] SEP 3 : Heart-beat mechanism between JobCoordinator and all running containers

+1 (binding) Awesome work. Cheers! Navina On Wed, May 3, 2017 at 12:01 PM, Jagadish Venkatraman < jagadish1...@gmail.com> wrote: > +1 from my side (as described in my previous email). > > Thanks for incorporating all feedback from my previous review. > > Nice work! > > On Wed, May 3, 2017 at

Re: [VOTE] Apache Samza 0.13.0 RC0

I will try to get the patch out today. Work doesn't look trivial. I am on it. Navina On May 14, 2017 23:10, "Ignacio Solis" <iso...@igso.net> wrote: > We should hold off until it is solved. How long will it take to fix this? > > On Sun, May 14, 2017 at 10:13 PM, Navi

Re: [VOTE] Apache Samza 0.13.0 RC0

tion above, can we officially cancel this vote? > > Thanks! > > -Yi > > On Mon, May 15, 2017 at 9:31 AM, Ignacio Solis <iso...@igso.net> wrote: > > > Thanks! > > > > On Mon, May 15, 2017 at 8:00 AM, Navina Ramesh > > <nram...@linkedin.com.inva

Re: [DISCUSS] SEP-5: Enable partition expansion of input streams

> 3) In the checkpoint/coordinator topic validation, KafkaCheckpointLogKey > > class validates the current grouper factory class == the previous grouper > > factory class in previous checkpoint. We need to make sure that we allow > > the compatible change from GroupByPartition to > Fix

Re: [VOTE] SEP-5: Enable partition expansion of input streams

After a lot of Q, let's get this done :) +1 (binding) Thanks! Navina On Tue, Jun 20, 2017 at 10:31 AM, xinyu liu wrote: > +1 (non-binding) on this design. > > To me the task-count based groupers should work well in practice for > partition expansion of system using hash

Re: Wiki Spam

Hi Mark, Thanks for letting us know. We will re-asses our permissions and set them up. Should we reach out to Gavin to set them up? It will be great to have one or more of the PMCs have access to assign permission to reduce the turn-over time. Please let us know the procedure. Thanks! Navina On

Re: Wiki Spam

> Given that admin privs are handed out to PMCs along with explicit instructions not to change the permissions for the anonymous user, I'd like to understand what went wrong in this case (with a view to ensuring it doesn't happen again) before re-enabling admin permissions. Agreed. Afaik, there

Re: Connection timed out error while installing "Hello Samza"

>> >> > 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0 cport:-1):: >> >> > PrepRequestProcessor@617] - Got user-level KeeperException when >> >> > processing sessionid:0x15e770d6192 type:delete cxid:0x34 zxid:0x17 >> >> > txntype:-

Re: Connection timed out error while installing "Hello Samza"

uot; - how to prove it is because of Firewall issue. I am able to clone Samza files from Apache git. I can download any external files on this server ~Sri -Original Message- From: Navina Ramesh [mailto:nram...@linkedin.com] Sent: Thursday, September 14, 2017 2:51 PM To: dev@samza.apac

Re: [VOTE] SEP-8: Add in-memory system consumer & producer

Hi Bharath, Really good design! 1. Based on your SEP, you have listed 3 implementation approaches. Do you know which one we are choosing? I suspect it is Approach C. Can you please confirm and update the SEP? 2. Perhaps rename "Test Plan" to "Proposed Usage" or "Usage Example"

Re: Connection timed out error while installing "Hello Samza"

Hi Anantharaman, It looks like a transient connection failure to connect to Apache's git. I tried on my host and it seems to be working. Can you give it another shot? If it still doesn't work, please let me know if you are running the command under the "master" or "latest" branch of

Re: Connection timed out error while installing "Hello Samza"

ptember 12, 2017 9:21:53 AM To: dev@samza.apache.org Subject: RE: Connection timed out error while installing "Hello Samza" Navina, Is there any other way we can install Hello Samza? Regards, ~Sri -Original Message- From: Navina Ramesh [mailto:nram...@linkedin.com] Sent: Tues

Re: Connection timed out error while installing "Hello Samza"

t: Tuesday, September 12, 2017 8:33:30 AM To: dev@samza.apache.org Subject: RE: Connection timed out error while installing "Hello Samza" Navina, I tried again but still same error While installing it says "Building samza from master..." But when after I cloned I executed " git

Re: Historical container logs in YARN UI

+Jon (Adding Jon to cc) From: Yi Pan Sent: Monday, October 2, 2017 2:10:27 AM To: dev@samza.apache.org Subject: Re: Historical container logs in YARN UI Hi, XiaoChuan, Our SRE team have been using timeline server in YARN at LinkedIn to get

Re: [DISCUSS] Samza 0.14.0 release

The list looks awesome! :) From: Jacob Maes Sent: Tuesday, November 28, 2017 10:03:58 AM To: dev@samza.apache.org Subject: Re: [DISCUSS] Samza 0.14.0 release +1 On Mon, Nov 27, 2017 at 8:15 PM, Fred Haifeng Ji wrote:

Re: [VOTE] SEP-12: Integration Test Framework

+1 can't wait to have this in! :) From: Jacob Maes Sent: Thursday, May 17, 2018 10:13:57 AM To: dev@samza.apache.org Subject: Re: [VOTE] SEP-12: Integration Test Framework +1 On Thu, May 17, 2018 at 9:56 AM, Jagadish Venkatraman <

Re: Welcome Xinyu as new Samza PMC!

Congratulations, Xinyu! Thanks for all your contribution and looking forward to more  Cheers! Navina From: Yi Pan Sent: Wednesday, January 17, 2018 10:26:54 AM To: dev@samza.apache.org Subject: Welcome Xinyu as new Samza PMC! Finally all

Re: [VOTE] Apache Samza 0.14.0 RC5

+1 on RC5. Verified signature and checksum. Ran ./bin/check-all.sh Cheers! Navina From: xinyu liu Sent: Friday, December 22, 2017 2:50:48 PM To: dev@samza.apache.org Subject: [VOTE] Apache Samza 0.14.0 RC5 This is a call for a vote on

Re: [VOTE] Migration of Samza git repo to gitbox.apache.org

It looks like a mandatory migration. Why do we need a vote for this? Thanks! Navina From: Pawas Chhokra Sent: Wednesday, January 23, 2019 11:50:32 AM To: dev@samza.apache.org Subject: [VOTE] Migration of Samza git repo to gitbox.apache.org Hi all, This is a

Re: [ANNOUNCE] Please welcome Boris Shkolnik to the Samza PMC

Yaay, Boris! Congrats!  From: Daniel Nishimura Sent: Friday, June 7, 2019 3:40 PM To: dev@samza.apache.org Subject: Re: [ANNOUNCE] Please welcome Boris Shkolnik to the Samza PMC Congrats! On Fri, Jun 7, 2019 at 3:35 PM Ignacio Solis wrote: > Congrats Boris! >

Re: Samza kinesis implementation

Hi Shekar, Last year, we had one of the Samza committers, Yan Fang, mentor a PhD student - Renato ,as a part of the GSoC program, where they worked on integrating Samza with Amazon Kinesis. I have cc'd the two of them so they can provide you more context. Here is the presentation from ApacheCon

Re: [DISCUSS] [VOTE] Apache Samza 0.11.0 RC0

Verified MD5, signature. Ran bin/check-all.sh on MacOS. My RHEL box is broken. I think others have tested it on RHEL. Hence, +1 (binding) from me! **On a side note** I think we need to upgrade the gradle version used by the bootstrap script to 2.6 or higher. At least, make sure that Samza

Re: [DISCUSS] SEP-1: Semantics of ProcessorId in Samza

f this logic could instead reside inside the > Job Coordinator (which is internal to the StreamProcessor) instead of > relying on something external to it? > > Of course, there may be other considerations around the way the current > code is structured that may prevent this. Let me know i

Re: Steps to Upgrading Samza (0.9 to 0.12)

@Jake: Yes. We removed the migration code (for 0.9 to 0.10) in the 0.11 release, I believe. @XiaoChuan: As per Jagadish's recommendation, if you have changelog backed stores, you should upgrade from 0.9.1 to 0.10.0 before upgrading to samza 0.12.0. I checked with LinkedIn's internal release

[VOTE] SEP-1: Semantics of ProcessorId in Samza

Hi everyone, This is a voting thread for SEP-1: Semantics of ProcessorId in Samza. For reference, here is the wiki link: https://cwiki.apache.org/confluence/display/SAMZA/SEP-1%3A+Semantics+of+ProcessorId+in+Samza Link to discussion mail thread:

Re: [DISCUSS] SEP-1: Semantics of ProcessorId in Samza

Navina On Tue, Mar 21, 2017 at 10:33 AM, Navina Ramesh (Apache) <nav...@apache.org> wrote: > Hi Jagadish, > Thanks for the suggestion. You are right in that it should be the > responsibility of the JobCoordinator to assign identifiers. > > > 'm only wondering if this log

Re: [DISCUSS] SEP-1: Semantics of ProcessorId in Samza

e a static factory method in > the ProcessorIdGenerator (Like what we have in ApplicationRunner): > > static ProcessIdGenerator fromConfig(Config config) { ... }. > > With this, It will be more convenient for the ApplicationRunner to > construct the generator. What do you think? &

[RESULT] [VOTE] SEP-1: Semantics of ProcessorId in Samza

Hi everyone, The vote on SEP-1 passes with 7 +1 votes (3 binding) and no -1. Votes are as follows: +1 (binding) - Navina Ramesh, Yi Pan, Yan Fang +1 (non-binding) - Boris Shkolnik, Xinyu Liu, Renato Marroquin Mogrovejo, Ignacio Solis The following are the discuss and vote mail threads: DISCUSS

Re: [VOTE] SEP-1: Semantics of ProcessorId in Samza

marroq...@gmail.com> wrote: > > > >> Thanks for the answers Navina! > >> > >> +1 (non-binding) > >> > >> 2017-03-30 22:32 GMT+02:00 Navina Ramesh <nram...@linkedin.com.invalid> > : > >> > >> > Hi Renato, > >> >

Re: Kafka client.id collision

Hi David, I think this is expected to occur as a warning since we spin up all kafka clients with the same client-id, which is $job.name + $job.id. As Jagadish mentioned, it will be great if you can provide us the entire log so that we can take a look. As a side note for the samza contributors,

Re: Samza Meetup

d in attending as I am in the area, it'd be my first > in-person Samza meetup :D > But unfortunately I don't have anything to present this time :( > > > Renato M. > > 2017-07-18 23:46 GMT-07:00 Navina Ramesh (Apache) <nav...@apache.org>: > > > Hi Renato, &g

Re: Samza Meetup

Hi Renato, We are planning for mid-August as a tentative target for the next meetup. If you are interested in participating or speaking at the meetup, please let us know. Thanks! Navina On Tue, Jul 18, 2017 at 10:36 AM, Renato Marroquín Mogrovejo < renatoj.marroq...@gmail.com> wrote: > Hi

Re: [DISCUSS] SEP-3: Heart-beat mechanism between JobCoordinator and all running containers

Hi Abhishek, I checked your latest proposal in SEP and it looks good to me. QQ: > A new ContainerHeartbeatMonitor class that accepts a ContainerHeartbeatClient (which has the business logic to make heartbeat checks on the JC endpoint) and a callback. Are you planning on exposing this monitor

Re: [VOTE] Apache Samza 0.13.0 RC0

I just changed the status of this JIRA to "BLOCKER" - https://issues.apache.org/jira/browse/SAMZA-1128 This causes a bug in standalone deployment where any failure in the barrier protocol stops the scheduled executorservice. Unfortunately, CoordinationUtils creates its own scheduled

Re: [VOTE] Apache Samza 0.13.0 RC0

tion above, can we officially cancel this vote? > > Thanks! > > -Yi > > On Mon, May 15, 2017 at 9:31 AM, Ignacio Solis <iso...@igso.net> wrote: > > > Thanks! > > > > On Mon, May 15, 2017 at 8:00 AM, Navina Ramesh > > <nram...@linkedin.com.inva

Re: [DISCUSS] SEP-5: Enable partition expansion of input streams

Thanks to Jake, Dong and Kartik for keeping the discussion going. > Here are the pros and cons of the extra re-partitioning stage in comparison to SEP-5. I think that is good summarization of pros/cons for the repartitioning stage based solution. Can you please include it in your SEP? It seems

Re: [DISCUSS] SEP-5: Enable partition expansion of input streams

M, Dong Lin <lindon...@gmail.com> wrote: > Thanks much for the reply Navina. Please see my reply inline. > > On Wed, Jun 21, 2017 at 2:57 PM, Navina Ramesh (Apache) <nav...@apache.org > > > wrote: > > > Thanks to Jake, Dong and Kartik for keeping the discussion going

Re: [VOTE] SEP-5: Enable partition expansion of input streams

After a lot of Q, let's get this done :) +1 (binding) Thanks! Navina On Tue, Jun 20, 2017 at 10:31 AM, xinyu liu wrote: > +1 (non-binding) on this design. > > To me the task-count based groupers should work well in practice for > partition expansion of system using hash

<    1   2   3   4   5   >