Re: [ANNOUNCE] Please welcome Boris Shkolnik to the Samza PMC

Yaay, Boris! Congrats!  From: Daniel Nishimura Sent: Friday, June 7, 2019 3:40 PM To: dev@samza.apache.org Subject: Re: [ANNOUNCE] Please welcome Boris Shkolnik to the Samza PMC Congrats! On Fri, Jun 7, 2019 at 3:35 PM Ignacio Solis wrote: > Congrats Boris! >

Re: [VOTE] Migration of Samza git repo to gitbox.apache.org

It looks like a mandatory migration. Why do we need a vote for this? Thanks! Navina From: Pawas Chhokra Sent: Wednesday, January 23, 2019 11:50:32 AM To: dev@samza.apache.org Subject: [VOTE] Migration of Samza git repo to gitbox.apache.org Hi all, This is a

Re: [VOTE] SEP-12: Integration Test Framework

+1 can't wait to have this in! :) From: Jacob Maes Sent: Thursday, May 17, 2018 10:13:57 AM To: dev@samza.apache.org Subject: Re: [VOTE] SEP-12: Integration Test Framework +1 On Thu, May 17, 2018 at 9:56 AM, Jagadish Venkatraman <

Re: Welcome Xinyu as new Samza PMC!

Congratulations, Xinyu! Thanks for all your contribution and looking forward to more  Cheers! Navina From: Yi Pan Sent: Wednesday, January 17, 2018 10:26:54 AM To: dev@samza.apache.org Subject: Welcome Xinyu as new Samza PMC! Finally all

Re: [VOTE] Apache Samza 0.14.0 RC5

+1 on RC5. Verified signature and checksum. Ran ./bin/check-all.sh Cheers! Navina From: xinyu liu Sent: Friday, December 22, 2017 2:50:48 PM To: dev@samza.apache.org Subject: [VOTE] Apache Samza 0.14.0 RC5 This is a call for a vote on

Re: [DISCUSS] Samza 0.14.0 release

The list looks awesome! :) From: Jacob Maes Sent: Tuesday, November 28, 2017 10:03:58 AM To: dev@samza.apache.org Subject: Re: [DISCUSS] Samza 0.14.0 release +1 On Mon, Nov 27, 2017 at 8:15 PM, Fred Haifeng Ji wrote:

Re: Historical container logs in YARN UI

+Jon (Adding Jon to cc) From: Yi Pan Sent: Monday, October 2, 2017 2:10:27 AM To: dev@samza.apache.org Subject: Re: Historical container logs in YARN UI Hi, XiaoChuan, Our SRE team have been using timeline server in YARN at LinkedIn to get

Re: Connection timed out error while installing "Hello Samza"

uot; - how to prove it is because of Firewall issue. I am able to clone Samza files from Apache git. I can download any external files on this server ~Sri -Original Message- From: Navina Ramesh [mailto:nram...@linkedin.com] Sent: Thursday, September 14, 2017 2:51 PM To: dev@samza.apac

Re: Connection timed out error while installing "Hello Samza"

>> >> > 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0 cport:-1):: >> >> > PrepRequestProcessor@617] - Got user-level KeeperException when >> >> > processing sessionid:0x15e770d6192 type:delete cxid:0x34 zxid:0x17 >> >> > txntype:-

Re: Connection timed out error while installing "Hello Samza"

ptember 12, 2017 9:21:53 AM To: dev@samza.apache.org Subject: RE: Connection timed out error while installing "Hello Samza" Navina, Is there any other way we can install Hello Samza? Regards, ~Sri -Original Message- From: Navina Ramesh [mailto:nram...@linkedin.com] Sent: Tues

Re: Connection timed out error while installing "Hello Samza"

t: Tuesday, September 12, 2017 8:33:30 AM To: dev@samza.apache.org Subject: RE: Connection timed out error while installing "Hello Samza" Navina, I tried again but still same error While installing it says "Building samza from master..." But when after I cloned I executed " git

Re: Connection timed out error while installing "Hello Samza"

Hi Anantharaman, It looks like a transient connection failure to connect to Apache's git. I tried on my host and it seems to be working. Can you give it another shot? If it still doesn't work, please let me know if you are running the command under the "master" or "latest" branch of

Re: [VOTE] SEP-8: Add in-memory system consumer & producer

Hi Bharath, Really good design! 1. Based on your SEP, you have listed 3 implementation approaches. Do you know which one we are choosing? I suspect it is Approach C. Can you please confirm and update the SEP? 2. Perhaps rename "Test Plan" to "Proposed Usage" or "Usage Example"

Re: [VOTE] Apache Samza 0.13.1 RC0

Ran check-all on Mac. Build looks good. +1 (binding) Thanks! Navina From: Fred Haifeng Ji Sent: Tuesday, August 22, 2017 11:19 AM To: dev@samza.apache.org Subject: Re: [VOTE] Apache Samza 0.13.1 RC0 [You don't often get email from

Re: [Discuss] Samza 0.13.1 release

Fred, Thanks for starting the release process. I am unable to open the link you have provided, though. It opens the JIRA SAMZA-1165, instead of the entire list of 0.13.1 bug fixes. Can you please re-check? Navina On 8/11/17, 6:13 PM, "ignacio.so...@gmail.com on behalf of Ignacio Solis"

Re: Kafka client.id collision

Hi David, I think this is expected to occur as a warning since we spin up all kafka clients with the same client-id, which is $job.name + $job.id. As Jagadish mentioned, it will be great if you can provide us the entire log so that we can take a look. As a side note for the samza contributors,

Re: Samza Meetup

d in attending as I am in the area, it'd be my first > in-person Samza meetup :D > But unfortunately I don't have anything to present this time :( > > > Renato M. > > 2017-07-18 23:46 GMT-07:00 Navina Ramesh (Apache) <nav...@apache.org>: > > > Hi Renato, &g

Re: Samza Meetup

Hi Renato, We are planning for mid-August as a tentative target for the next meetup. If you are interested in participating or speaking at the meetup, please let us know. Thanks! Navina On Tue, Jul 18, 2017 at 10:36 AM, Renato Marroquín Mogrovejo < renatoj.marroq...@gmail.com> wrote: > Hi

Re: [VOTE] SEP-5: Enable partition expansion of input streams

After a lot of Q, let's get this done :) +1 (binding) Thanks! Navina On Tue, Jun 20, 2017 at 10:31 AM, xinyu liu wrote: > +1 (non-binding) on this design. > > To me the task-count based groupers should work well in practice for > partition expansion of system using hash

Re: [VOTE] SEP-5: Enable partition expansion of input streams

After a lot of Q, let's get this done :) +1 (binding) Thanks! Navina On Tue, Jun 20, 2017 at 10:31 AM, xinyu liu wrote: > +1 (non-binding) on this design. > > To me the task-count based groupers should work well in practice for > partition expansion of system using hash

Re: [DISCUSS] SEP-5: Enable partition expansion of input streams

> 3) In the checkpoint/coordinator topic validation, KafkaCheckpointLogKey > > class validates the current grouper factory class == the previous grouper > > factory class in previous checkpoint. We need to make sure that we allow > > the compatible change from GroupByPartition to > Fix

Re: [DISCUSS] SEP-5: Enable partition expansion of input streams

M, Dong Lin <lindon...@gmail.com> wrote: > Thanks much for the reply Navina. Please see my reply inline. > > On Wed, Jun 21, 2017 at 2:57 PM, Navina Ramesh (Apache) <nav...@apache.org > > > wrote: > > > Thanks to Jake, Dong and Kartik for keeping the discussion going

Re: [DISCUSS] SEP-5: Enable partition expansion of input streams

Thanks to Jake, Dong and Kartik for keeping the discussion going. > Here are the pros and cons of the extra re-partitioning stage in comparison to SEP-5. I think that is good summarization of pros/cons for the repartitioning stage based solution. Can you please include it in your SEP? It seems

Re: [VOTE] Apache Samza 0.13.0 RC6

+1 (binding) Thanks to everyone for diligently testing out the RCs and getting this release out! Cheers! Navina On Thu, Jun 8, 2017 at 9:09 AM, Chris Riccomini wrote: > +1 (binding) > > On Wed, Jun 7, 2017 at 8:55 AM, Yi Pan wrote: > > > +1

Re: Wiki Spam

> Given that admin privs are handed out to PMCs along with explicit instructions not to change the permissions for the anonymous user, I'd like to understand what went wrong in this case (with a view to ensuring it doesn't happen again) before re-enabling admin permissions. Agreed. Afaik, there

Re: Wiki Spam

Hi Mark, Thanks for letting us know. We will re-asses our permissions and set them up. Should we reach out to Gavin to set them up? It will be great to have one or more of the PMCs have access to assign permission to reduce the turn-over time. Please let us know the procedure. Thanks! Navina On

Re: [DISCUSS] SEP-5: Enable partition expansion of input streams

dded, Samza will need to explicitly subscribe to the new partitions > > of the topic. The "Handle partition expansion while tasks are running" > > section in the SEP addresses this issue in Samza -- it recalculates the > job > > model and restart container so that consumer

Re: [DISCUSS] SEP-5: Enable partition expansion of input streams

if this, together with the answers in the previous > email, addresses all your questions? Thanks for taking time to review the > proposal. > > Regards, > Dong > > > > > > > > On Wed, May 24, 2017 at 11:15 PM, Dong Lin <lindon...@gmail.com> wrote: > > >

[VOTE] Apache Samza 0.13.0 RC1

Hi everyone, This is a call for a vote on a release of Apache Samza 0.13.0. Thanks to everyone who has contributed to this release. We are very glad to see some new contributors and features in this release. The release candidate can be downloaded from here:

Re: [VOTE] Apache Samza 0.13.0 RC0

tion above, can we officially cancel this vote? > > Thanks! > > -Yi > > On Mon, May 15, 2017 at 9:31 AM, Ignacio Solis <iso...@igso.net> wrote: > > > Thanks! > > > > On Mon, May 15, 2017 at 8:00 AM, Navina Ramesh > > <nram...@linkedin.com.inva

Re: [VOTE] Apache Samza 0.13.0 RC0

tion above, can we officially cancel this vote? > > Thanks! > > -Yi > > On Mon, May 15, 2017 at 9:31 AM, Ignacio Solis <iso...@igso.net> wrote: > > > Thanks! > > > > On Mon, May 15, 2017 at 8:00 AM, Navina Ramesh > > <nram...@linkedin.com.inva

Re: [DISCUSS] SEP-4: Adjunct Data Store for Unbounded DataSets

Thanks for trying 3 times, Wei. Sorry about the trouble. Not sure where the problem lies. Looking forward to review your design. Navina On Tue, May 16, 2017 at 8:56 AM, Wei Song wrote: > Hey everyone, > > I created a proposal for SAMZA-1278 >

Re: [VOTE] Apache Samza 0.13.0 RC0

I will try to get the patch out today. Work doesn't look trivial. I am on it. Navina On May 14, 2017 23:10, "Ignacio Solis" <iso...@igso.net> wrote: > We should hold off until it is solved. How long will it take to fix this? > > On Sun, May 14, 2017 at 10:13 PM, Navi

Re: [VOTE] Apache Samza 0.13.0 RC0

I just changed the status of this JIRA to "BLOCKER" - https://issues.apache.org/jira/browse/SAMZA-1128 This causes a bug in standalone deployment where any failure in the barrier protocol stops the scheduled executorservice. Unfortunately, CoordinationUtils creates its own scheduled

Re: [VOTE] SEP 3 : Heart-beat mechanism between JobCoordinator and all running containers

+1 (binding) Awesome work. Cheers! Navina On Wed, May 3, 2017 at 12:01 PM, Jagadish Venkatraman < jagadish1...@gmail.com> wrote: > +1 from my side (as described in my previous email). > > Thanks for incorporating all feedback from my previous review. > > Nice work! > > On Wed, May 3, 2017 at

Re: [DISCUSS] SEP-3: Heart-beat mechanism between JobCoordinator and all running containers

Hi Abhishek, I checked your latest proposal in SEP and it looks good to me. QQ: > A new ContainerHeartbeatMonitor class that accepts a ContainerHeartbeatClient (which has the business logic to make heartbeat checks on the JC endpoint) and a callback. Are you planning on exposing this monitor

Re: Review Request 58866: fixed SAMZA-1248. use processor id for stand alone barrier

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/58866/#review173529 --- Ship it! - Navina Ramesh On May 1, 2017, 11:24 p.m., Boris

Re: Review Request 58866: fixed SAMZA-1248. use processor id for stand alone barrier

/ZkJobCoordinator.java Line 65 (original), 65 (patched) <https://reviews.apache.org/r/58866/#comment246410> Why is newJobModel useful? Please add some comments as it is not very obvious. - Navina Ramesh On April 28, 2017, 11:54 p.m., Boris Shkolnik

Re: Review Request 58851: SAMZA-1212 - Refactor interaction between StreamProcessor, JobCoordinator and SamzaContainer

://reviews.apache.org/r/58851/diff/1/ Testing --- unit tests and ./gradlew clean build Thanks, Navina Ramesh

Review Request 58851: SAMZA-1212 - Refactor interaction between StreamProcessor, JobCoordinator and SamzaContainer

f37a224f64eec162e60e3a891b257175dbf4ec3c samza-test/src/test/scala/org/apache/samza/test/integration/StreamTaskTestUtil.scala 29fb6d3f6e07f356d4a25556221fa76ecdc7bf77 Diff: https://reviews.apache.org/r/58851/diff/1/ Testing --- unit tests and ./gradlew clean build Thanks, Navina Ramesh

Re: [DISCUSS] SEP-2: ApplicationRunner Design

Hey Yi, Thanks for lot for your work on this document. I know it must have been crazy trying to put-together everything in a single doc :) Here are my comments. Sorry about the delay :( 1. It will be useful to set some background for the benefit of the community members who haven't been

Re: [VOTE] Samza Logo

5 star > > > ones, you're missing your vote on the ones you don't like. > > > > > > So, once we close, we'll see how people voted. > > > > > > Nacho > > > > > > > > > On Fri, Apr 14, 2017 at 9:21 PM, Yi Pan <nickpa...@

Re: [VOTE] Samza Logo

d. But feel free to leave comments here, > maybe you can try to persuade people or argue for your favorite. :-) > > Nacho > > On Fri, Apr 14, 2017 at 2:31 PM, Navina Ramesh > <nram...@linkedin.com.invalid> wrote: > > Hi Nacho, > > Do you want us to vote on this ma

Re: [VOTE] Samza Logo

Hi Nacho, Do you want us to vote on this mail thread or directly at design crowd? Thanks! Navina On Fri, Apr 14, 2017 at 2:19 PM, Ignacio Solis wrote: > Hi folks. > > After some feedback and culling, we are down to 4 candidates. Please > vote on your favorite designs. We will

Re: Samza Logo designs

Hi Nacho, I rated on the designcrowd website directly. In terms of feedback: 1. I like the concept of using a butterfly to indicate "metamorphosis". However, a lot of the designs there look like a bow-tie :) 2. I think we should stick with a red theme for the name. Sorry about the late response.

[RESULT] [VOTE] SEP-1: Semantics of ProcessorId in Samza

Hi everyone, The vote on SEP-1 passes with 7 +1 votes (3 binding) and no -1. Votes are as follows: +1 (binding) - Navina Ramesh, Yi Pan, Yan Fang +1 (non-binding) - Boris Shkolnik, Xinyu Liu, Renato Marroquin Mogrovejo, Ignacio Solis The following are the discuss and vote mail threads: DISCUSS

Re: [VOTE] SEP-1: Semantics of ProcessorId in Samza

marroq...@gmail.com> wrote: > > > >> Thanks for the answers Navina! > >> > >> +1 (non-binding) > >> > >> 2017-03-30 22:32 GMT+02:00 Navina Ramesh <nram...@linkedin.com.invalid> > : > >> > >> > Hi Renato, > >> >

Re: [VOTE] SEP-1: Semantics of ProcessorId in Samza

st, > > Renato M. > > 2017-03-30 20:45 GMT+02:00 Navina Ramesh <nram...@linkedin.com.invalid>: > > > Hi Yi, > > Good question. Three reasons: > > > > 1. In SAMZA-881, we came up with a set of responsibilities for the > > JobCoordinator. One

Re: Steps to Upgrading Samza (0.9 to 0.12)

Hi everyone, Apologize for re-chiming in late on this issue. > I'm not sure I agree with the policy (removing migration code and wanting people to upgrade seem at odds to me), but minimally I think we should not assume people are upgrading to each new Samza version. I agree that we should not

Re: [VOTE] SEP-1: Semantics of ProcessorId in Samza

ing to which processorId we are getting. > > Otherwise, the proposal looks good. > > -Yi > > On Wed, Mar 29, 2017 at 7:57 PM, Navina Ramesh > <nram...@linkedin.com.invalid > > wrote: > > > Good to hear from you, Yan. Thanks! :) > > > > On Wed, Mar 29,

Re: [VOTE] SEP-1: Semantics of ProcessorId in Samza

7 at 2:00 PM, xinyu liu <xinyuliu...@gmail.com> > > wrote: > > > > > > > +1 on my side. Very happy to see this proposal. This is a blocker for > > > > integrating fluent API with StreamProcessor, and hopefully we can get > > it > > > > res

Re: [VOTE] SEP-1: Semantics of ProcessorId in Samza

> +1 on my side. Very happy to see this proposal. This is a blocker for > > integrating fluent API with StreamProcessor, and hopefully we can get it > > resolved soon :). > > > > Thanks, > > Xinyu > > > > On Tue, Mar 28, 2017 at 11:28 AM, Navina R

[VOTE] SEP-1: Semantics of ProcessorId in Samza

Hi everyone, This is a voting thread for SEP-1: Semantics of ProcessorId in Samza. For reference, here is the wiki link: https://cwiki.apache.org/confluence/display/SAMZA/SEP-1%3A+Semantics+of+ProcessorId+in+Samza Link to discussion mail thread:

Re: Steps to Upgrading Samza (0.9 to 0.12)

@Jake: Yes. We removed the migration code (for 0.9 to 0.10) in the 0.11 release, I believe. @XiaoChuan: As per Jagadish's recommendation, if you have changelog backed stores, you should upgrade from 0.9.1 to 0.10.0 before upgrading to samza 0.12.0. I checked with LinkedIn's internal release

Re: [DISCUSS] SEP-1: Semantics of ProcessorId in Samza

Navina On Tue, Mar 21, 2017 at 10:33 AM, Navina Ramesh (Apache) <nav...@apache.org> wrote: > Hi Jagadish, > Thanks for the suggestion. You are right in that it should be the > responsibility of the JobCoordinator to assign identifiers. > > > 'm only wondering if this log

Re: [DISCUSS] SEP-1: Semantics of ProcessorId in Samza

Navina On Tue, Mar 21, 2017 at 10:33 AM, Navina Ramesh (Apache) <nav...@apache.org> wrote: > Hi Jagadish, > Thanks for the suggestion. You are right in that it should be the > responsibility of the JobCoordinator to assign identifiers. > > > 'm only wondering if this log

Re: [DISCUSS] SEP-1: Semantics of ProcessorId in Samza

f this logic could instead reside inside the > Job Coordinator (which is internal to the StreamProcessor) instead of > relying on something external to it? > > Of course, there may be other considerations around the way the current > code is structured that may prevent this. Let me know i

Re: [DISCUSS] Support Scala 2.12

Thanks for creating the DISCUSS email! This is good. It's a good idea to update to 2.12 since it looks like we are fully backward compatible with older versions. +1 from me. Cheers! Navina On Fri, Mar 17, 2017 at 1:34 PM, Jagadish Venkatraman < jagadish1...@gmail.com> wrote: > Thanks for

Re: [DISCUSS] SEP-1: Semantics of ProcessorId in Samza

e client to use. > > I am working on the ApplicationRunner SEP right now. Will send out the > discussion email once I am done. > > Thanks, > Xinyu > > On Thu, Mar 16, 2017 at 4:50 PM, Navina Ramesh (Apache) <nav...@apache.org > > > wrote: > > > > One m

Re: [DISCUSS] SEP-1: Semantics of ProcessorId in Samza

e a static factory method in > the ProcessorIdGenerator (Like what we have in ApplicationRunner): > > static ProcessIdGenerator fromConfig(Config config) { ... }. > > With this, It will be more convenient for the ApplicationRunner to > construct the generator. What do you think? &

Re: [DISCUSS] SAMZA-1141 - Apache Samza Development Process Improvements

oposal as the first > SEP (like SEP-0), so it serves an example of how it will look like in > practice? > > Xinyu > > On Tue, Mar 14, 2017 at 3:34 PM, Navina Ramesh > <nram...@linkedin.com.invalid > > wrote: > > > Just to clarify: The proposal for code and design pr

Re: [DISCUSS] SAMZA-1141 - Apache Samza Development Process Improvements

Venkatraman < jagadish1...@gmail.com> wrote: > Thanks for writing this up. > > I'm +1 on this proposal. > > > > On Tue, Mar 14, 2017 at 3:15 PM, Navina Ramesh (Apache) <nav...@apache.org > > > wrote: > > > Hi everyone, > > > > We switch

Re: [VOTE] Apache Samza 0.12.0 RC2

I ran check-all against Mac and integration tests on Linux. Looks good with no concerning issues. +1 (binding) Thanks! Navina On Fri, Feb 10, 2017 at 9:25 AM, Boris S wrote: > I also successfully ran the integration tests on Linux. All passed. > +1 non-binding > > On Wed,

Re: Review Request 52570: SAMZA-1025: documentation for hdfs system consumer

an emphasize the reserved term note by doing -> **note** , when it is outside the code block docs/learn/documentation/versioned/jobs/configuration-table.html (line 1822) <https://reviews.apache.org/r/52570/#comment234763> Look like a typo. It should "systems.*, instead of &quo

Re: Review Request 52570: SAMZA-1025: documentation for hdfs system consumer

> On Jan. 25, 2017, 10:36 p.m., Jagadish Venkatraman wrote: > > docs/learn/documentation/versioned/hdfs/consumer.md, line 67 > > > > > > The relationship between whitelist and blacklist was not very obvious > > to

Re: Review Request 52570: SAMZA-1025: documentation for hdfs system consumer

> On Jan. 25, 2017, 10:50 p.m., Navina Ramesh wrote: > > docs/learn/documentation/versioned/hdfs/consumer.md, line 26 > > <https://reviews.apache.org/r/52570/diff/2/?file=1613256#file1613256line26> > > > > Can you include the diagram from your design doc

Re: Review Request 52570: SAMZA-1025: documentation for hdfs system consumer

Looks like there are more configurations that are mentioned in the configuration table. Can you please add the link to configuration table to imply that? docs/learn/documentation/versioned/hdfs/consumer.md (line 105) <https://reviews.apache.org/r/52570/#comment234466> You can add

Upcoming Stream Processing Meetup in February!

Hi everyone, We would like to invite you to a Stream Processing Meetup at LinkedIn’s Sunnyvale campus on Thursday, February 16 at 6pm. Please RSVP here (if you intend to attend in person): https://www.meetup.com/Stream-Processing-Meetup-LinkedIn/events/237171557/

Re: [DISCUSS] Samza 0.12.0 release

+1 Navina On Fri, Dec 23, 2016 at 2:53 PM, xinyu liu wrote: > +1 on the new release. > > Thanks, > Xinyu > > On Fri, Dec 23, 2016 at 2:50 PM, Yi Pan wrote: > > > Yep! Thanks for pointing it out! @Shanthoosh, can you update the list > > accordingly?

Re: SAMZA-469 - scala 2.11 / move to java?

. > > Thanks! > Thunder > > > -Original Message- > From: Navina Ramesh [mailto:nram...@linkedin.com.INVALID] > Sent: Thursday, November 10, 2016 2:19 PM > To: dev@samza.apache.org > Subject: Re: SAMZA-469 - scala 2.11 / move to java? > > Hi Thunder, > Sorry

Re: SAMZA-469 - scala 2.11 / move to java?

Hi Thunder, Sorry about the late response. I was refreshing my memory of SAMZA-469 :) Is there something preventing this from getting into a release? > Seems to me like the main roadblock on upgrading to scala 2.11 was related to JDK6. We have already moved away from JDK6 and JDK7. So, I don't

Re: Review Request 52168: Tasks endpoint to list the complete details of all tasks related to a job

ting an instance of ConfigFactory. Why not use the ClassLoaderHelper directly whereever this is used? - Navina Ramesh On Oct. 24, 2016, 10 p.m., Shanthoosh Venkataraman wrote: > > --- > This is an automatically generated e-mail

Re: Review Request 52962: SAMZA-1029: Prepare release candidate for 0.11.0

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/52962/#review153001 --- Ship it! Ship It! - Navina Ramesh On Oct. 18, 2016

Re: Review Request 52960: SAMZA-1029: Prepare release candidate for 0.11.0

(line 51) <https://reviews.apache.org/r/52960/#comment06> Shouldn't this be 0.11.1-SNAPSHOT as well? - Navina Ramesh On Oct. 17, 2016, 11:45 p.m., Xinyu Liu wrote: > > --- > This is an automatically generated e-mail.

Re: [VOTE] Apache Samza 0.11.0 RC2

Validated MD5 and build. Ran check-all and integration test on Mac. +1 (binding) Thanks! Navina On Tue, Oct 11, 2016 at 1:16 PM, Yi Pan wrote: > Build, validated MD5, test w/ integration tests and passed. Thanks! > > +1 (binding) > > On Mon, Oct 10, 2016 at 4:07 PM, xinyu

Re: [DISCUSS] [VOTE] Apache Samza 0.11.0 RC0

Verified MD5, signature. Ran bin/check-all.sh on MacOS. My RHEL box is broken. I think others have tested it on RHEL. Hence, +1 (binding) from me! **On a side note** I think we need to upgrade the gradle version used by the bootstrap script to 2.6 or higher. At least, make sure that Samza

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

-- > > (Updated Sept. 28, 2016, 9:57 p.m.) > > > Review request for samza, Yi Pan (Data Infrastructure) and Navina Ramesh. > > > Bugs: SAMZA-967 > https://issues.apache.org/jira/browse/SAMZA-967 > > > Reposito

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

/#review150883 --- On Sept. 28, 2016, 9:57 p.m., Hai Lu wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/51142/ > ------- > &g

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

h (line 27) <https://reviews.apache.org/r/51142/#comment218688> If we want to use this only for the azkaban runner, we should perhaps rename the file as run-job-for-azkaban.sh or something on those lines. - Navina Ramesh On Sept. 20, 2016,

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

the set of compatible APIs! So, I > guess that we just enforce avro-1.4 when compiling samza-hdfs module? I > remember that I tried last time and got a build failure in samza-hdfs w/ > AvroDataFileHdfsWriter in samza-li build. I am curious how you made it work. > > Navin

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

lemented the bucketized locking as a > > built-in method already: > > http://www.tutorialspoint.com/guava/guava_caching_utilities.htm > > Navina Ramesh wrote: > What was the resolution here? Was there any change to the IO pattern to > use caching? > > Hai Lu wrot

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

gt; ----------- > > (Updated Sept. 20, 2016, 11:22 p.m.) > > > Review request for samza, Chris Pettitt, Yi Pan (Data Infrastructure), and > Navina Ramesh. > > > Bugs: SAMZA-967 > https://issues.apache.org/jira/brows

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

n samza-hdfs and samza-kafka? It seems to have been introduced by the HdfsSystemProducer. Can we please fix it forward? Or as Yi suggested, please create a JIRA and add a TODO comment here referring to the JIRA Thanks! - Navina Ramesh On Sept. 20, 20

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/51142/ > --- > > (Updated Sept. 20, 2016, 11:22 p.m.) > > > Review request for samza, Chris Pettitt, Yi Pan (Data Infrastructure),

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

> > (Updated Sept. 20, 2016, 11:22 p.m.) > > > Review request for samza, Chris Pettitt, Yi Pan (Data Infrastructure), and > Navina Ramesh. > > > Bugs: SAMZA-967 > https://issues.apache.org/jira/browse/SAMZA-967 > > > Re

Re: Review Request 52066: change warn about loopback address to a debug

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/52066/#review149877 --- Ship it! Ship It! - Navina Ramesh On Sept. 19, 2016, 8:55

Re: Issue with consuming non-existent topics in 0.10.1

ker has finished creating the topic and returns the correct partition > metadata. The optimized path introduced by the SAMZA-971 fix goes into > KafkaSystemAdmin.getSystemStreamPartitionCounts() which does not check > this errorCode, and simply returns an empty set of partitions. Does that > m

Re: Question about Samza Metrics

Hi Shuqi, It depends on the type of metric you are looking for. Most counters and gauges are cumulative. Timer is the only metrics that works within a sliding window (if I am not mistaken). What usecase are you trying to solve? Thanks! Navina On Mon, Sep 12, 2016 at 11:50 PM, 舒琦

Re: Issue with consuming non-existent topics in 0.10.1

Hi Tommy, Yi and I discussed about it and initially, we thought it could have something to do with the topic auto-creation setting on your Kafka server. Is it enabled or disabled in your case? I kind of suspect that the request timeout is insufficient. However, we do have retries on Samza to

Re: Samza kinesis implementation

Hi Shekar, Last year, we had one of the Samza committers, Yan Fang, mentor a PhD student - Renato ,as a part of the GSoC program, where they worked on integrating Samza with Amazon Kinesis. I have cc'd the two of them so they can provide you more context. Here is the presentation from ApacheCon

Re: Review Request 51630: SAMZA-1007: Pass job config from factory to grouper

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51630/#review148404 --- Ship it! Ship It! - Navina Ramesh On Sept. 6, 2016, 8:41

Re: Review Request 51726: SAMZA-1005: Refactor class instantiation code to a helper class.

of the occurrences of Class loaders :) Thanks for the patch! - Navina Ramesh On Sept. 8, 2016, 12:44 p.m., Branislav Cogic wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache

Re: Question about Samza Metrcis

Hi ShuQi, Auto-creation of streams depends on your Kafka server configuration. In case of coordinator stream and checkpoint stream, samza explicitly creates a stream with 1 partition before publishing to it. This doesn't apply for metrics. So, if auto-creation is turned off in kafka server, then

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

> On Aug. 31, 2016, 12:54 a.m., Navina Ramesh wrote: > > docs/learn/documentation/versioned/jobs/configuration-table.html, line 357 > > <https://reviews.apache.org/r/50174/diff/3/?file=1488352#file1488352line357> > > > > Is it too late to comment on the conf

Re: Review Request 50174: SAMZA-977: User doc for samza multithreading

-- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/50174/ > --- > > (Updated Sept. 7, 2016, 5:16 p.m.) > > > Review request for samza, Chris Petti

Re: Periodic cleanup of unused local stores

Hi Santhosh, Thanks for picking SAMZA-656. This is long overdue and will help make our host-affinity based solution more robust. I have a couple of thoughts on your design proposal. 1. It is always very useful to provide more context to the reader, esp. in explaining what the different terms

Re: Review Request 51630: SAMZA-1007: Pass job config from factory to grouper

thanks! - Navina Ramesh On Sept. 5, 2016, 6:05 p.m., Neil Fordyce wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.

Re: Review Request 51142: SAMZA-967: HDFS System Consumer

f the file represent the file length ? (in suffix string) Or did you just add it for testing? - Navina Ramesh On Aug. 29, 2016, 5:27 p.m., Hai Lu wrote: > > --- > This is a

Re: Review Request 51516: SAMZA-702: Document the significance of all the different metrics emitted by Samza out of the box

container/metrics-table.html (line 795) <https://reviews.apache.org/r/51516/#comment214711> did you mean per-system here? - Navina Ramesh On Aug. 30, 2016, 7:36 a.m., Branislav Cogic wrote: > > --- > This is an automatically ge

Re: Review Request 51516: SAMZA-702: Document the significance of all the different metrics emitted by Samza out of the box

cular system stream partition docs/learn/documentation/versioned/container/metrics-table.html (line 379) <https://reviews.apache.org/r/51516/#comment214705> nit: Average time spent polling all underlying systems for new messages (in nanoseconds) - Navina Ramesh On Aug. 30, 2016, 7:

  1   2   3   4   5   >