Re: Proposal : build single linux binary

2017-12-07 Thread Ning Wang
Sounds good. Is there any concern about the system libs used in the cpp binaries? On Thu, Dec 7, 2017 at 8:53 PM, Sanjeev Kulkarni wrote: > sounds good > > On Thu, Dec 7, 2017 at 8:45 PM, Karthik Ramasamy > wrote: > > > Sounds good. > > > > On Thu, Dec

Re: Slurm Scheduler

2017-12-03 Thread Ning Wang
+1. I think your idea of moving them into a different directory makes sense in case some people need it. On Sat, Dec 2, 2017 at 11:44 PM, Sanjeev Kulkarni wrote: > +1 > > On Sat, Dec 2, 2017 at 10:57 PM Ali Ahmed wrote: > > > I support deprecating it

Re: Stateful updating and deterministic routing

2018-05-05 Thread Ning Wang
Currently I think each Instance serializes the state object into a byte array and checkpoint manager saves the byte array into a file. The file is referenced by topology name + component name + instance id. On Fri, May 4, 2018 at 11:10 PM, Karthik Ramasamy wrote: > I am not

Re: Stateful updating and deterministic routing

2018-05-05 Thread Ning Wang
it be better? > > cheers > /karthik > > > On Fri, May 4, 2018 at 11:23 PM, Ning Wang <wangnin...@gmail.com> wrote: > > > Currently I think each Instance serializes the state object into a byte > > array and checkpoint manager saves the byte array into a file.

Re: Stateful updating and deterministic routing

2018-05-04 Thread Ning Wang
Interesting. Thanks for sharing~ On Fri, May 4, 2018 at 2:31 PM, Thomas Cooper wrote: > Hi all, > > A while ago I emailed about the issue of how fields (key) grouped routing > in Heron was not consistent across an update and how this makes preserving > state across an

Re: Stateful updating and deterministic routing

2018-05-07 Thread Ning Wang
> > https://docs.google.com/document/d/1YDFNvLTX6Sg3WDrNFKiWLaJvuEtK4 > eyxEaA0w9cVlG4/edit#heading=h.d6uy2uxfs2xq > > cheers > /karthik > > > On Sun, May 6, 2018 at 8:20 AM, Bill Graham <billgra...@gmail.com> wrote: > >> Can you share the doc please? >

Re: Heron OSS Sync

2018-05-08 Thread Ning Wang
Got it. Thanks! Yeah. Cadidate is our goal. On Tue, May 8, 2018 at 4:21 PM, Dave Fisher <dave2w...@comcast.net> wrote: > Thanks for the quick update! > > > On May 8, 2018, at 4:08 PM, Ning Wang <wangnin...@gmail.com> wrote: > > > > And here is a brief no

Heron OSS Sync

2018-05-08 Thread Ning Wang
Hi, The heron OSS sync meeting will be happening today at 2.00 pm PST. Please use the following hangout link: https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync?authuser=0 See you all then.

Re: Heron OSS Sync

2018-05-08 Thread Ning Wang
7:21 PM, Dave Fisher <dave2w...@comcast.net> wrote: > > > > Thanks for the quick update! > > > >> On May 8, 2018, at 4:08 PM, Ning Wang <wangnin...@gmail.com> wrote: > >> > >> And here is a brief notes: > >> > >> > >> > >&g

Re: Stateful updating and deterministic routing

2018-05-07 Thread Ning Wang
; On Mon, May 7, 2018 at 12:41 AM, Ning Wang <wangnin...@gmail.com> wrote: > >> Thanks Karthik. The doc is not exactly the same but close enough. >> >> It seems my doc is an internal one so let's use your doc as reference. I >> will see if there is any major differe

Re: Stateful updating and deterministic routing

2018-05-05 Thread Ning Wang
ng, which > was intended to be done as a future phase. It's very similar to what's > being described. Sanjeev and I worked on it about a 1.5 years ago with > Maosong and it was in a google doc. Sanjeev do you have that design doc? I > can't seem locate it. > > On Sat, May 5,

Re: Heron github emails [VOTE RESULTS]

2018-05-18 Thread Ning Wang
+1! On Fri, May 18, 2018 at 7:28 PM, Karthik Ramasamy wrote: > +1 as well. > > On Fri, May 18, 2018 at 7:18 PM Josh Fischer wrote: > > > We have 7 positive votes and NO vetos. I will take the necessary steps > to > > get this change completed. > > > >

Re: Heron OSS Sync

2018-05-23 Thread Ning Wang
://issues.apache.org/jira/browse/INFRA-16561 gitpubsub: https://issues.apache.org/jira/browse/INFRA-16562 Please feel free to comment if I missed anything or there is any mistakes. On Tue, May 22, 2018 at 3:20 PM, Ning Wang <wangnin...@gmail.com> wrote: > Brief notes: > > >

Heron OSS Sync

2018-05-22 Thread Ning Wang
Hi, The heron OSS sync meeting will be happening today at 2.00 pm PDT. Please use the following hangout link: https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync?authuser=0 See you all then.

Re: Heron OSS Sync

2018-05-22 Thread Ning Wang
aurora container (causing duplicated stmgr issue).- Async ack/emit/fail PR is green to merge. To document the requirements/limitations.- Traffic prediction model is on going.- There are many old issues/PRs to clean up.* On Tue, May 22, 2018 at 1:21 PM, Ning Wang <wangnin...@gmail.com> wrote:

ML in Heron weekly meeting

2018-06-08 Thread Ning Wang
Brief notes for today's meeting: - Review DD: https://docs.google.com/document/d/1LrO7XRcMxJoMM83wjRd-Ov74VAaomA_mXOAhCStgGng/edit - We want to understand better about the bigger picture of ML in stream processing systems. -- talk to ML users -- doc of related systems to read: ---

Heron OSS Sync

2018-06-18 Thread Ning Wang
Hi, The heron OSS sync meeting will be happening tomorrow at 2.00 pm PDT. Please use the following hangout link: https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync?authuser=0 See you all then.

Re: Heron OSS Sync

2018-06-18 Thread Ning Wang
Thanks! You are right!!! Let me send it again. On Mon, Jun 18, 2018 at 4:55 PM, Jerry Peng wrote: > Ning, > > I think you mean tomorrow correct? > > On Mon, Jun 18, 2018 at 4:54 PM Ning Wang wrote: > > > Hi, > > > > The heron OSS sync meeting will be ha

Heron OSS Sync

2018-06-18 Thread Ning Wang
Hi, The heron OSS sync meeting will be happening today at 2.00 pm PDT. Please use the following hangout link: https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync?authuser=0 See you all then.

Re: Heron OSS Sync

2018-06-19 Thread Ning Wang
. - Huijun adding toggleable switch into Dhalion. - Yao working on new integration test for topology structure. - Fario started to take the traffic modeling project from Thomas. On Mon, Jun 18, 2018 at 8:58 PM, Ning Wang wrote: > Thanks for asking. > > Normally we talk about

Re: Heron OSS Sync

2018-06-05 Thread Ning Wang
much progress in the new release so far. Twitter forks will reach > out to Bill/Sijie for suggestions.- Productionize stateful process in > Twitter. Found an issue with local checkpoint expiration. - Downloader has > been refactored to be more flexible. - Discussed zombie aurora container >

Re: Heron OSS Sync

2018-06-04 Thread Ning Wang
ur > questions will be answered before the “sync up” by participating in the > global asynchronous advantage of emails! > > Please think about this! > > Regards, > Dave > > [1] https://incubator.apache.org/guides/releasemanagement.html > [2] https://www.youtube.com/watch?

Heron OSS Sync

2018-06-04 Thread Ning Wang
Hi, The heron OSS sync meeting will be happening tomorrow at 2.00 pm PDT. Please use the following hangout link: https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync?authuser=0 See you all then.

Re: Heron OSS Sync

2018-06-05 Thread Ning Wang
about Streamlet interface and acking mechanism. On Mon, Jun 4, 2018 at 5:05 PM, Ning Wang wrote: > Hi, > > The heron OSS sync meeting will be happening tomorrow at 2.00 pm PDT. > Please use the following hangout link: > https://hangouts.google.com/hangouts/_/streaml.io

Re: [DISCUSS] A design proposal for incorporating machine learning algorithms into heron

2018-06-22 Thread Ning Wang
My thoughts: 1. sounds good! 2. I feel it might be better to be separated so we can focus on one problem each time. 3. depending on how hard it is to add in future I feel. 4. not sure. On Wed, May 9, 2018 at 7:39 AM, Saikat Kanjilal wrote: > FYI for those that dont know about Michaelangelo:

Re: Building error

2018-06-24 Thread Ning Wang
t isn't great. > > On 24 June 2018 at 04:30, Ning Wang wrote: > > > Got it. Thanks~ > > > > On Sat, Jun 23, 2018 at 4:28 PM, Oliver Bristow < > > oli...@oliverbristow.co.uk> > > wrote: > > > > > There's an issue <https://github.com/bazel

ML in Heron weekly meeting

2018-06-23 Thread Ning Wang
Brief notes for the meeting on June 22th: - still studying the documents. --- https://mapr.com/blog/monitoring-real-time-uber- data-using-spark-machine-learning-streaming-and-kafka-api-part-2/ --- https://databricks.com/blog/2018/06/05/introducing-mlflow-

Building error

2018-06-23 Thread Ning Wang
It seems bazel build is failing ( https://travis-ci.org/apache/incubator-heron/builds/395945899?utm_source=github_status_medium=notification) currently because of the following error: (22:58:33) ERROR:

Re: Apache Releases

2018-06-19 Thread Ning Wang
Here is a quick PR to clean up Twitter related content in the governance/community pages. There are still a few things to be updated later. https://github.com/apache/incubator-heron/pull/2926 On Tue, Jun 19, 2018 at 8:57 PM, Ning Wang wrote: > Thank you very much! > > On Tue, Jun

Re: Apache Releases

2018-06-19 Thread Ning Wang
Thank you very much! On Tue, Jun 19, 2018 at 4:22 PM, Dave Fisher wrote: > Hi - > > Here are some resources and notes about Apache Releases: > > Special rules for incubating projects. > https://incubator.apache.org/guides/releasemanagement.html > > General policies. >

Re: ML in Heron weekly meeting

2018-06-30 Thread Ning Wang
-Ov74VAaomA_mXOAhCStgGng/edit On Sat, Jun 23, 2018 at 3:44 PM, Ning Wang wrote: > Brief notes for the meeting on June 22th: > > - still studying the documents. > --- https://mapr.com/blog/monitoring-real-time-uber-data-using- > spark-machine-learning-streaming-and-kafka-api-part-2/

Re: Copyright Violations

2018-05-01 Thread Ning Wang
Thanks for bringing it up! Too many things going on and we haven't got time to update the license text yet. We will work on it. This is the first update on the NOTICE file. Does it look ok this way? https://github.com/apache/incubator-heron/pull/2878 Thanks in advance. On Tue, May 1, 2018 at

Re: Copyright Violations

2018-05-02 Thread Ning Wang
; > It’s important that everyone strive to adopt the Apache Way. > > -Taylor > > > On May 2, 2018, at 1:59 PM, Ning Wang <wangnin...@gmail.com> wrote: > > > > Prepared two PRs to update license text so far: > > > > https://github.com/apache/incub

Re: Heron OSS Sync

2018-07-03 Thread Ning Wang
AM, Ning Wang wrote: > Hi, > > Sorry for the late notice The heron OSS sync meeting will be > happening today at 2.00 pm PDT. Please use the following hangout link: > https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync > ?authuser=0 > > > See you all then. > >

Re: Heron OSS Sync - 01/30/18

2018-01-30 Thread Ning Wang
Please look for another message from Karthik, with subject "Heron Sync up Meeting Notes". Also please feel free to comment. On Tue, Jan 30, 2018 at 5:28 PM, Saikat Kanjilal wrote: > All, > Apologies but I missed this , we’re there any notes or output conversation > that you

Re: About stream manager's quitting logic on connection failures

2018-02-05 Thread Ning Wang
orm that to stmgrclientmgr which keeps a map of > peerstmgrid to error count. Thus it is able to decide things like am i > seeing connection errors from all stmgrs or if only a few of them are > having issues. Then it can take the decisions better. > > On Sat, Feb 3, 2018 at 8:11 PM, Ning Wang &l

Re: About stream manager's quitting logic on connection failures

2018-02-05 Thread Ning Wang
PR is here: https://github.com/twitter/heron/pull/2711 It should be quite simple, most changes are in config files. On Mon, Feb 5, 2018 at 1:40 PM, Ning Wang <wangnin...@gmail.com> wrote: > Cool. Thanks! > > On Mon, Feb 5, 2018 at 11:01 AM, Karthik Ramasamy <kramas...@

Re: Our Meetup group

2018-02-13 Thread Ning Wang
Great! On Tue, Feb 13, 2018 at 9:37 PM, Karthik Ramasamy wrote: > Thanks Sree for creating a group. Look forward to our first event. > > cheers > /karthik > > > On Feb 13, 2018, at 9:35 PM, Sree V > wrote: > > > > yup, it was the auto

Re: About stream manager's quitting logic on connection failures

2018-02-05 Thread Ning Wang
t; This sounds good to me! > > > > On Mon, Feb 5, 2018 at 1:08 AM, Ning Wang <wangnin...@gmail.com> wrote: > > > >> Yeah. That is an option too. In fact it was my first try: > >> https://github.com/twitter/heron/pull/2693 (just an initiative, not > >>

Re: Proposing Changes To Heron

2018-02-26 Thread Ning Wang
+1 for Heron SQL On Sun, Feb 25, 2018 at 9:28 PM, Jerry Peng wrote: > Thanks Josh for taking the initiative to get this start! SQL on Heron > will be a great feature! The plan sounds great to me. Lets first get > an initial version of the Heron SQL out and then we

Re: Heron OSS Sync

2018-06-18 Thread Ning Wang
e > > Sent from my iPhone > > > On Jun 18, 2018, at 4:56 PM, Ning Wang wrote: > > > > Hi, > > > > The heron OSS sync meeting will be happening tomorrow at 2.00 pm PDT. > > Please use the following hangout link: > > https://hangouts.google.com/hangouts/_/streaml.io/oss- > heron-sync?authuser=0 > > > > > > See you all then. >

Re: Heron OSS Sync

2018-08-14 Thread Ning Wang
Josh Fischer wrote: > I will be on for the first 30 minutes. > > Josh > > On Tue, Aug 14, 2018 at 1:50 PM Jerry Peng > wrote: > > > Sounds good. I will attend the OSS sync meeting today > > > > On Tue, Aug 14, 2018 at 11:22 AM Ning Wang wrote: > >

Re: Rough Draft to Podling Report

2018-08-07 Thread Ning Wang
nice! On Tue, Aug 7, 2018 at 8:06 AM, Josh Fischer wrote: > The Heron Incubator PMC report has been submitted. > > - Josh > > On Tue, Aug 7, 2018 at 1:06 AM, Josh Fischer wrote: > > > Thank you both for the feedback. Taylor, I appreciate the suggestion of > > looking back at the ASF policies

Re: [VOTE] Heron Release 0.20.0-incubating Candidate 1

2018-08-17 Thread Ning Wang
Thanks a lot Dave, That's super helpful to us! On Wed, Aug 15, 2018 at 4:25 PM Dave Fisher wrote: > Hi - > > Thanks for providing this. Some key items are missing. I have to VOTE -1 > (While I am not on this PPMC I am giving you a head start with an IPMC > binding vote.) > > (1) A detached

Re: [VOTE] Heron Release 0.20.0-incubating Candidate 2

2018-08-22 Thread Ning Wang
-1 we found a compiling issue caused by a script (status.sh) that requires git environment. On Wed, Aug 22, 2018 at 11:00 AM Neng Lu wrote: > Hi All, > > This is the 2nd release candidate for Apache Heron, version > 0.20.0-incubating. Thanks Dave Fisher for providing various feedback for > the

Re: Heron OSS Sync Meeting

2018-09-10 Thread Ning Wang
One thing I think we may need to discuss tomorrow is to find a replacement for Google hangout. We have seen some issues(cant accept requests) in the past a few weeks. On Mon, Sep 10, 2018 at 10:02 AM Ning Wang wrote: > Hi, > > The heron OSS sync meeting will be happening tomorrow a

Heron OSS Sync Meeting

2018-09-10 Thread Ning Wang
Hi, The heron OSS sync meeting will be happening tomorrow at 2.00 pm PDT. Please use the following hangout link: https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync?authuser=0 See you all then.

Re: [VOTE] Heron Release 0.20.0-incubating Candidate 3

2018-08-29 Thread Ning Wang
./third_party/python/semver/README.md > == File: ./third_party/python/semver/semver.py > == File: ./third_party/python/semver/setup.py > == File: ./third_party/yaml-cpp/yaml.BUILD > == File: ./third_party/zookeeper/zookeeper.BUILD > == File: ./tools/bazel.rc > == File: ./tools/bui

Re: ML in Heron weekly meeting

2018-07-05 Thread Ning Wang
ey have had low activity since early this year. > > Regards, > Dave > > > On Jun 29, 2018, at 11:01 PM, Ning Wang wrote: > > > > Brief notes for the meeting on June 29: > > > > - We need to hook up heron with Apache samoa. Saikat to create new issues >

Heron OSS Sync

2018-07-03 Thread Ning Wang
Hi, Sorry for the late notice The heron OSS sync meeting will be happening today at 2.00 pm PDT. Please use the following hangout link: https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync?authuser=0 See you all then.

Re: Proposing Changes To ECO

2018-01-22 Thread Ning Wang
tsBase64); > } > // Format for TOPOLOGY_COMPONENT_JVMOPTS would be a json map like this: > // { > // "componentNameAInBase64": "jvmOptionsInBase64", > // "componentNameBInBase64": "jvmOptionsInBase64" > // } > conf

Re: Release Today/Tomorrow

2018-02-27 Thread Ning Wang
sgtm On Tue, Feb 27, 2018 at 2:27 AM, Karthik Ramasamy wrote: > Ok let us do a release. Any objections to do a release? > > Sent from my iPhone > > > On Feb 27, 2018, at 1:57 AM, Chris Kellogg wrote: > > > > It's a little more involved then i thought.

Re: Moving to Apache

2018-02-28 Thread Ning Wang
us.apache.org/ > > > > repos/asf/incubator-heron.githttps://jira.apache.org/ > > > > jira/browse/INFRA-16116 > > > > > > > > We need INFRA create, https://github.com/apache/incubator-heron > > > > https://jira.apache.org/jira/browse/INFRA-1611

Re: Heron OSS Sync

2018-03-13 Thread Ning Wang
And here are the brief notes for today's meeting: * - Maosong needs to contact with Apache admin about github to apache/github.- After code migration is done, we are going to follow apache release process- Sree is following up on the site and documentations- A few bug fixes on k8s support were

Heron OSS Sync

2018-04-10 Thread Ning Wang
The bi-weekly Heron OSS sync meeting will be happening today at 2.00 pm PST. Pl ease use the following hangoutlink to join. https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync?authuser=0 See you all then.

Re: Regarding package renaming PR#2840

2018-04-05 Thread Ning Wang
Make sense to me. On Thu, Apr 5, 2018 at 9:19 AM, Ashvin A wrote: > Hi Devs, > > PR 2840 renames com.twitter package to org.apache. This change touches more > than *2,127* files. Is there a test strategy for this change which updates > everything? I believe just depending

Re: Build machine provisioning and release access

2018-04-05 Thread Ning Wang
Cool. Thanks! On Thu, Apr 5, 2018 at 11:39 AM, Jake Farrell wrote: > Hey Ali > The ASF Jenkins build system is at https://builds.apache.org/ and setup > details are available at > https://cwiki.apache.org/confluence/display/INFRA/Jenkins . We can not > create release

A new resource config proposal

2018-04-18 Thread Ning Wang
In the discussions with a few developers, we have some new thoughts about the resource config and packing algorithms in heron. Basically we want to step back from the current configs and try to come up with a new solution from user's point of view. Here is a brief proposal document for reference

Re: Heron OSS Sync

2018-04-24 Thread Ning Wang
. Looking into issue with Intellij.* On Tue, Apr 24, 2018 at 1:55 PM, Ning Wang <wangnin...@gmail.com> wrote: > Will be happening today at 2.00 pm PST. Please use the following hangou > link: > https://hangouts.google.com/hangouts/_/streaml.io/oss-heron- > sync?authuser=0 > > > See you all then. >

Heron OSS Sync

2018-04-24 Thread Ning Wang
Will be happening today at 2.00 pm PST. Please use the following hangou link: https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync?authuser=0 See you all then.

Re: Heron OSS Sync Meeting notes

2018-03-27 Thread Ning Wang
ve > > Sent from my iPhone > > > On Mar 27, 2018, at 4:51 PM, Ning Wang <wangnin...@gmail.com> wrote: > > > > A little more details about the hangout issue: > > > > Owner of hangout meeting is responsible to accept incoming requests. > Since

Re: Heron OSS Sync Meeting notes

2018-03-27 Thread Ning Wang
A little more details about the hangout issue: Owner of hangout meeting is responsible to accept incoming requests. Since Karthik is sick today so we had to create a new temporary meeting, which is not ideal. On Tue, Mar 27, 2018 at 4:09 PM, Ning Wang <wangnin...@gmail.com> wrote: &g

Re: Heron OSS Sync Meeting notes

2018-03-27 Thread Ning Wang
ay. > > > - Hangout is killing us today! We need a better solution. > > > Discuss items in plain sight of the whole community on this list. This > allows other developers to participate asynchronously. > > Regards, > Dave > > > On Mar 27, 2018, at 3:47 PM, Ning Wa

CI job for heron

2018-03-30 Thread Ning Wang
Hi, Dave, It seems that we need to update heron CI job for unit tests and integration tests. We used Travis previously. I am wondering if there is a CI engine in Apache infra? Or is there any suggestion? Thanks in advance.

Re: [MENTORS] Re: Heron Non Apache Release 0.17.8

2018-03-30 Thread Ning Wang
For 2, 0.17.7 was released in late Feb I believe and there have been new features/fixes since then. On Fri, Mar 30, 2018 at 10:31 AM, Dave Fisher wrote: > Hi - > > Adding the tag that Taylor mentioned to help signal when the project has > questions. > > While I on the

Re: Heron Non Apache Release 0.17.8

2018-03-30 Thread Ning Wang
SGTM On Fri, Mar 30, 2018 at 10:05 AM, Karthik Ramasamy wrote: > All - > > Since we have been planning to release 0.17.8 till last week, I would > suggest that we can go ahead with this release. However this release will > be a non Apache release since there are several task

Re: CI job for heron

2018-03-30 Thread Ning Wang
Got it. Thanks. I will take a look. The previous Travis service is a Twitter paid service I think, so it is time to consider our options. On Fri, Mar 30, 2018 at 10:36 AM, Dave Fisher <dave2w...@comcast.net> wrote: > Hi - > > > On Mar 29, 2018, at 11:37 PM, Ning Wang <

Heron is in Apacheinfra home now

2018-03-29 Thread Ning Wang
Hi, Heron git repo has moved to the new home! https://github.com/apache/incubator-heron Apache committers should link their ASF IDs and Github IDs as well as enable 2FA on Github: https://gitbox.apache.org/setup/ so they can commit to Github. Otherwise Apache credentials to

Re: Getting binaries out of the code base

2018-04-02 Thread Ning Wang
nice! On Sun, Apr 1, 2018 at 7:10 PM, Karthik Ramasamy wrote: > This PR successfully passed Travis and merged! > > Cheers > /karthik > > Sent from my iPhone > > > On Apr 1, 2018, at 10:44 AM, Karthik Ramasamy > wrote: > > > > All - > > > > As a first

Re: Fault tolerance

2018-03-20 Thread Ning Wang
Two features I can think of: Dhalion https://blog.acolyer.org/2017/06/30/dhalion-self-regulating-stream-processing-in-heron/ Backpressure Streammanager is responsible for all data transactions and it monitors the data consumption. If a process runs slow and incoming data buffer is full, it

Re: Heron Sync Up 02/27/2017

2018-02-27 Thread Ning Wang
gards, > Dave > > Sent from my iPhone > > > On Feb 27, 2018, at 4:33 PM, Ning Wang <wangnin...@gmail.com> wrote: > > > > All - > > > > We had the sync up meeting today and here is the brief note. > > > > https://docs.google.com/document/

Re: Heron Sync Up 02/27/2017

2018-02-27 Thread Ning Wang
. On Tue, Feb 27, 2018 at 6:56 PM, Ning Wang <wangnin...@gmail.com> wrote: > Got it. Thanks! > > On Tue, Feb 27, 2018 at 6:23 PM, Dave Fisher <dave2w...@comcast.net> > wrote: > >> Please post the notes into an email so that we can see what was discussed &

Re: Moving to Apache

2018-02-27 Thread Ning Wang
Sounds good to me. maosong@, do you have any concerns? On Tue, Feb 27, 2018 at 3:23 PM, Sanjeev Kulkarni wrote: > Thanks Jerry for taking the lead on this! > I second the proposal to just transfer the github account to Apache. Could > someone from Twitter follow up

Heron Sync Up 02/27/2017

2018-02-27 Thread Ning Wang
All - We had the sync up meeting today and here is the brief note. https://docs.google.com/document/d/1cTIBq3jOVRTSR0Zd5OKK20OqwT2l90xXiY_HssVo8mE/edit?ts=5a15c620# Please feel free to comment or reply if you have any question.

Re: Moving to Apache

2018-02-27 Thread Ning Wang
I created a google doc for us to track questions and plans: https://docs.google.com/document/d/1-G5qbFN1ftDRf42Dee_BjlEZ75C-gVdGJ_uaGIL8qx8/edit# On Tue, Feb 27, 2018 at 4:23 PM, Josh Fischer wrote: > Dave, > > Thank you for the suggestions. This is fantastic advice. >

Re: Using Bazel 0.14.1+

2018-06-28 Thread Ning Wang
Thanks~ On Thu, Jun 28, 2018 at 8:29 AM, Oliver Bristow wrote: > Hey folks, #2932 > updated > the repo to use 0.14.1 - it would be good to update your local version to > be that or greater. > > Without a newer version you may experience an

Proposal: Streamlet Custom Operator

2018-09-27 Thread Ning Wang
Hi, I was trying to add the support to reuse existing Bolts in the Streamlet API last week and got some feedbacks about the feature and the improvements. After reconsidering what I want to have, I think it can be generalized a bit to "Custom Operator". Here is a design doc to summerize what in

Heron OSS Sync Meeting

2018-10-08 Thread Ning Wang
Hi, heron devs, The heron OSS sync meeting will be happening tomorrow at 2.00 pm PDT. Please use the following hangout link: https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync?authuser=0 Like we discussed earlier, updates will be communicated via email. Here are mine: - Shared

Re: Hermetic Build Proposal

2018-10-12 Thread Ning Wang
Sounds reasonable to me. On Fri, Oct 12, 2018 at 11:26 AM Josh Fischer wrote: > Hey All, > > I've done some research and I do not think Heron's Bazel configuration is > hermetic. What I mean by this is that to build Heron we are relying on the > JDK on the host platform. If JDK versions

Re: [VOTE] Heron Release 0.20.0-incubating Candidate 5

2018-10-18 Thread Ning Wang
PM Ning Wang wrote: > Thanks! > > I am going to try it when I get time. > > On Tue, Oct 16, 2018 at 10:45 AM Neng Lu wrote: > >> Hi All, >> >> This is the 5th release candidate for Apache Heron, version >> 0.20.0-incubating. Thanks everyone for prov

Heron OSS Sync meeting

2018-10-22 Thread Ning Wang
Hi, heron devs, The heron OSS sync meeting will be happening tomorrow at 2.00 pm PDT. Please use the following hangout link: https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync?authuser=0 Please reply this email with your updates. Thanks! Here are my updates: - Added

Re: Podling Report Reminder - November 2018

2018-10-24 Thread Ning Wang
; > towards bootstrapping the project..Signed-off-by: [ ](heron) Jake > > > Farrell Comments: [ ](heron) Jacques Nadeau Comments: [ > > > ](heron) Julien Le Dem Comments: [x](heron) P. Taylor Goetz > > > Comments: I'm concerned about lack of activity on the publ

Re: Podling Report Reminder - November 2018

2018-11-03 Thread Ning Wang
at 6:53 AM Josh Fischer wrote: > We still need to finish the podling report. I don't have an answer for many > of these questions this time around. I'll need someone else to fill them > in. Once they are complete I can submit it for us. > > > > On Thu, Oct 25, 2018 at 12:13 AM N

Re: [Mentors] Podling Report Reminder - November 2018

2018-11-04 Thread Ning Wang
For "Have your mentors been helpful and responsive or are things falling through the cracks? " I think the answer is: Definitely helpful and responsive. On Sun, Nov 4, 2018 at 12:24 AM Ning Wang wrote: > Thanks! > > On Sat, Nov 3, 2018 at 3:42 PM Justin Mclean wrote:

Re: [Mentors] Podling Report Reminder - November 2018

2018-11-04 Thread Ning Wang
Thanks~ :D On Sun, Nov 4, 2018 at 5:11 AM Josh Fischer wrote: > Thanks Justin. I didn’t realize that the forms change. I’ll get a new > draft sent out here in a bit. > > Ning, > > Good answer I’ll add it in! > > > On Sun, Nov 4, 2018 at 1:25 AM Ning Wang wrote: &

Re: Podling Report Reminder - November 2018

2018-10-20 Thread Ning Wang
Is there a template? We can start a google doc and collaborate on it. Karthik has been super duper busy so I am not sure if he will have the time, but some questions might for him? On Sat, Oct 20, 2018 at 6:05 AM Josh Fischer wrote: > Hey All, > > Does anyone want to fill out the Podling

11/06/2018 Bi-Weekly OSS Heron Sync-up

2018-11-05 Thread Ning Wang
Hi All, It has been two weeks since our last sync and now is time to share our progress again. Let's share our works done for the last two weeks in this thread. And see if we need some hangout discussions or not. >From my side: Helped to prepare the Heron release and pod report Continue working

Re: BazelCon

2018-11-05 Thread Ning Wang
Nice intro! Thanks! On Mon, Nov 5, 2018 at 12:49 PM Josh Fischer wrote: > Hey All, > > I did a talk at Google's Headquarters in NYC last October on how Apache > Heron is built with Bazel. Here is the link if you are interested ~> > https://www.youtube.com/watch?v=yBTSfA4YDtY= > > - Josh >

Re: Building on MacOS 10.14

2018-11-15 Thread Ning Wang
Great! On Thu, Nov 15, 2018 at 10:50 PM Dave Fisher wrote: > That worked! > > INFO: Elapsed time: 758.221s, Critical Path: 168.57s > INFO: 2565 processes: 2235 local, 330 worker. > INFO: Build completed successfully, 4380 total actions > > > > On Nov 15, 2018, a

Re: [Mentors] Podling Report Reminder - November 2018

2018-11-05 Thread Ning Wang
Thanks! On Mon, Nov 5, 2018 at 5:33 PM Dave Fisher wrote: > I signed off on the report. > > I did add that Ning Wang was elected as a committer and accepted on > 11/1/2018. > > Regards, > Dave > > > On Nov 5, 2018, at 5:00 PM, Josh Fischer wrote: > > >

Re: [Mentors] Podling Report Reminder - November 2018

2018-11-05 Thread Ning Wang
mmitters or PPMC members elected > * None as of yet.* > Have your mentors been helpful and responsive or are things falling > through the cracks? In the latter case, please list any open issues > that need to be addressed. > *Mentors have been very responsive and helpful.* > >

Re: [Mentors] Podling Report Reminder - November 2018

2018-11-05 Thread Ning Wang
SGTM. Thanks! On Mon, Nov 5, 2018 at 4:12 PM Dave Fisher wrote: > No. Please go ahead and file. > > Sent from my iPhone > > > On Nov 5, 2018, at 4:01 PM, Ning Wang wrote: > > > > LGTM~ > > > > We need an approval from mentors before submission? &g

Re: Proposal: Streamlet Custom Operator

2018-09-28 Thread Ning Wang
Thanks~ On Thu, Sep 27, 2018 at 9:26 PM Karthik Ramasamy wrote: > Thanks Ning - Nice proposal and looks good for me. > > On Thu, Sep 27, 2018 at 11:25 AM Ning Wang wrote: > > > Hi, > > > > I was trying to add the support to reuse existing Bolts in the Streamlet

Re: [VOTE] Heron Release 0.20.0-incubating Candidate 4

2018-09-25 Thread Ning Wang
All, > > > > This is the 4th release candidate for Apache Heron, version > 0.20.0-incubating. Thank Dave Fisher and Ning Wang for providing various > feedback for the previous release candidates. > > > > It is the starting point of Heron and contains heron's main features,

Re: Heron OSS Sync Meeting

2018-09-25 Thread Ning Wang
use it as > the main discussion place. > > The sync meet should only play as a supplementary role. > > On Mon, Sep 24, 2018 at 2:12 PM Ning Wang wrote: > > > Hi, > > > > > > The heron OSS sync meeting will be happening tomorrow at 2.00 pm PDT. > >

Discussion of the support of Bolt/Spout in Streamlet API

2018-09-19 Thread Ning Wang
Hi, all, We had a discussion in this PR but I am feeling that it would be good to gather more thoughts from other devs/users as well. https://github.com/apache/incubator-heron/pull/3029#pullrequestreview-156614156 During Twitter internal onboarding of Streamlet API, I started to consider

Re: Discussion of the support of Bolt/Spout in Streamlet API

2018-09-19 Thread Ning Wang
t > to take fine grained control if using the Streamlet API. > > > > On Wed, Sep 19, 2018 at 12:22 PM Ning Wang wrote: > > > Hi, all, > > > > We had a discussion in this PR but I am feeling that it would be good to > > gather more thoughts from other devs/user

Heron OSS Sync Meeting

2018-09-24 Thread Ning Wang
Hi, The heron OSS sync meeting will be happening tomorrow at 2.00 pm PDT. Please use the following hangout link: https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync?authuser=0 There has been suggestions about communicating regular biweekly updates via this mailing list. It could be

Re: Heron Spouts Code

2019-01-16 Thread Ning Wang
+Siming On Tue, Jan 15, 2019 at 11:35 PM Ning Wang wrote: > Hi, all, > > A few of us (Spencer, Saikat, Siming, Karthik, Josh, Sree) discussed today > in our general slack channel that we should have spouts code somewhere so > that people can reuse them (spouts are highly reus

Re: Heron Spouts Code

2019-01-16 Thread Ning Wang
ith the capability of Bazel, so certainly I’m not > against it. If it can help to achieve some of the above, I guess one single > repo will also work then. > > SiMing > > On Wed, Jan 16, 2019 at 5:34 PM Ning Wang wrote: > >> +Siming >> >> On Tue, Jan 15, 2019 at 11:

  1   2   3   >