Re: PEX upgrade to 1.2.11

Currently, Maintaining pex is a pain for us. If we can get rid of its source code. That would be really great. Also, I verified this change with our environment. It passed our building process. On Mon, Sep 18, 2017 at 10:16 AM, Karthik Ramasamy wrote: > All - > > I would

Re: Heron Release

Hi all, Bring up the release again, user is requesting the fix: https://github.com/twitter/heron/pull/2291 And I think we already have a bunch of new thing merged since last release. Could we schedule a release by the end of this week or early next week? On Thu, Sep 14, 2017 at 4:57 PM, Fu

Re: Inter-Container Encryption in Heron

Having separate key pair for each container might have scalability issue for some really large topologies. As far as I know, Twitter has some prod topolog's whose # of containers could be as large as 400+. On Fri, Sep 15, 2017 at 11:29 PM, Sanjeev Kulkarni wrote: > Having a

Re: Specifying Operator Resource in DSL

Just add some thoughts here: for ordinary heron topologies, the definition of a heron job and the request of resources usage for each component are separated: `TopologyBuilder` for job definition, `Config` for resource requirement. In the dsl case, if we could also do something similar that

Re: Stateful updating and deterministic routing

+1 for this idea. As long as the predefined key space is large enough, it should work for most of the cases. Based on my experience with topologies, I never saw one component has more than 1000 instances in a topology. For recovering states from an update, there will be some problems though.

Proposal of Alternatively Transferring State via Disk

Hi all, During our test at twitter, when a state is very large (GBs), the current checkpointing mechanism doesn't work well. Here's a proposal of transferring large checkpointing state through local disk to solve the problem we've found.

Re: Rough Draft to Podling Report

Thanks for composing the report! On Tue, Aug 7, 2018 at 12:50 PM Karthik Ramasamy wrote: > Thanks Josh > > On Tue, Aug 7, 2018 at 8:37 AM Ning Wang wrote: > > > nice! > > > > On Tue, Aug 7, 2018 at 8:06 AM, Josh Fischer > wrote: > > > > > The Heron Incubator PMC report has been submitted. > >

[VOTE] Heron Release 0.20.0-incubating Candidate 1

-incubating-candidate-1 Please download the the source package, and follow the compiling guide( https://apache.github.io/incubator-heron/docs/developers/compiling/compiling/) to build and run the Heron locally. Best Regards, Neng Lu

Re: [VOTE] Heron Release 0.20.0-incubating Candidate 1

s/#guidelines > > , http://www.apache.org/foundation/marks/faq/#poweredby , and > > https://www.apache.org/foundation/press/kit/ > > > > The icomoon font in the tools/ui has licenses that are incompatible with > > Apache releases. I would not block this rele

Re: [VOTE] Heron Release 0.20.0-incubating Candidate 2

uires git > environment. > > On Wed, Aug 22, 2018 at 11:00 AM Neng Lu wrote: > > > Hi All, > > > > This is the 2nd release candidate for Apache Heron, version > > 0.20.0-incubating. Thanks Dave Fisher for providing various feedback for > > the first relea

Re: how to enable travis ci hook

I tried to disable and enable the heron repo but found I don't have the permission to do so. Anyone has this permission? [image: image (1).png] [image: image (2).png] On Tue, Aug 21, 2018 at 10:44 PM Karthik Ramasamy wrote: > Not that I am aware of > > On Tue, Aug 21, 2018 at 10:39 PM, FatJ

[VOTE] Heron Release 0.20.0-incubating Candidate 3

package, and follow the compiling guide( https://apache.github.io/incubator-heron/docs/developers/compiling/compiling/) to build and run the Heron locally. Best Regards, Neng Lu

[VOTE] Heron Release 0.20.0-incubating Candidate 2

/docs/developers/compiling/compiling/) to build and run the Heron locally. Best Regards, Neng Lu

07/17 Heron OSS Sync Notes

Hi all, Here are the notes for today's sync meeting: * - Project Updates- Added integration tests for instance state- Fixing the large state spilling problem- Developing a framework for monitoring backpressure- New OSS heron meetings in the Bay area will be launched soon.- The apache release

09/11/2018 Heron OSS Sync Notes

Hi all, Here are the notes for today's sync meeting: - Several Release Candidates are done in the last few weeks. There is some work remaining to be done for the next RC: - We need to fix the out of data website - A user reported problems when launching topology

Re: Hermetic Build Proposal

This is a great proposal! On Sat, Oct 13, 2018 at 7:33 PM Sree V wrote: > created an issue to implement and track this. > https://github.com/apache/incubator-heron/issues/3045 > > > Thank you.Sree > > On Friday, October 12, 2018, 8:43:40 PM PDT, Karthik Ramasamy < > kart...@streaml.io>

[VOTE] Heron Release 0.20.0-incubating Candidate 5

Hi All, This is the 5th release candidate for Apache Heron, version 0.20.0-incubating. Thanks everyone for providing various feedback for the previous release candidates. It is the starting point of Heron and contains heron's main features, such as streaming processing, stateful processing,

Re: [VOTE] Heron Release 0.20.0-incubating Candidate 5

t; > - example topology runs fine locally > > > - ui/tracker work fine and show topology info > > > - license scan with apache-rat (rat couldn't find license in > > cloudpickle.py > > > but it is there) > > > > > > > > > > > >

10/22/2018 Bi-Weekly OSS Heron Sync-up

Hi All, It has been two weeks since our last sync and now is time to share our progress again. Let's share our works done for the last two weeks in this thread. And see if we need some online discussion for difficult problems. >From Twitter's side: 1. Ning Drafted the streamlet custom operator

Re: Podling Report Reminder - November 2018

Any update on this Podling Report task? On Sat, Oct 20, 2018 at 10:46 AM Ning wrote: > Cool. Thanks! > > Sent from my iPhone > > > On Oct 20, 2018, at 10:13 AM, Josh Fischer wrote: > > > > I’ve pasted in the report from August. You can access where the template > > is to be input here —-> > >

Re: 10/22/2018 Bi-Weekly OSS Heron Sync-up

Neutral. > > > 2. Merit is given to individuals. > > > > > > With that in mind for the next reports: > > > > > > A. There should not be a “Twitter side”. There is what contributors are > > > doing. > > > B. It helps to read on this mailing list a report

[VOTE] Heron Release 0.20.0-incubating Candidate 3

Hi All, This is the 4th release candidate for Apache Heron, version 0.20.0-incubating. Thank Dave Fisher and Ning Wang for providing various feedback for the previous release candidates. It is the starting point of Heron and contains heron's main features, such as streaming processing, stateful

Re: Heron OSS Sync Meeting

+1 for this idea. We should utilize more of the mailing list and use it as the main discussion place. The sync meet should only play as a supplementary role. On Mon, Sep 24, 2018 at 2:12 PM Ning Wang wrote: > Hi, > > > The heron OSS sync meeting will be happening tomorrow at 2.00 pm PDT. >

[VOTE] Heron Release 0.20.0-incubating Candidate 4

Hi All, This is the 4th release candidate for Apache Heron, version 0.20.0-incubating. Thank Dave Fisher and Ning Wang for providing various feedback for the previous release candidates. It is the starting point of Heron and contains heron's main features, such as streaming processing, stateful

Re: 11/20/2018 Bi-Weekly Heron Sync-up

Hi, We passed the voting process for our first Apache release - 0.20.0. And the source code release is available at https://dist.apache.org/repos/dist/release/incubator/heron/ Besides, I prepared a "Heron Stateful Processing" talk at this month's meetup. On Mon, Nov 19, 2018 at 10:05 AM Ning

Re: Need to step down as mentor

Thank you very much for all the help you provided to Heron! On Sun, Sep 16, 2018 at 10:28 PM Karthik Ramasamy wrote: > Thanks Jacques. Understand that you are busy - thanks for the help so far. > > cheers > /karthik > > On Sun, Sep 16, 2018 at 1:09 AM Ning Wang wrote: > > > Thanks for your

[CVE-2018-11789] Apache Incubator Heron file access vulnerability

Severity: Important Vendor: The Apache Software Foundation Versions Affected: Heron 0.13.0 to 0.17.8 Description: When accessing the heron-ui webpage, people can modify the file paths outside of the current container to access any file on the host. Mitigation: All Heron users should upgrade to

07/29/2019 Bi-Weekly OSS Heron Sync-up

Hi, all~, It has been two weeks since our last sync! Let's share our works for the last two weeks in this thread. my updates: 1. we made a new release internally and identified some stmgr performance degradation issue -- Best Regards, Neng

7/16/2019 Bi-Weekly OSS Heron Sync-up

Hi, all~, It has been two weeks since our last sync! Let's share our works for the last two weeks in this thread. -- Best Regards, Neng

New committer: Xiaoyao Qian

. Best regards, Neng Lu