Heron OSS Sync meeting

[Ning Wang]

Hi, heron devs,

The heron OSS sync meeting will be happening tomorrow at 2.00 pm PDT.
Please use the following hangout link:
https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync?authuser=0

Please reply this email with your updates. Thanks!

Here are my updates:

- Added IStreamletOperator interfaces for existing bolts.
- First pass of CustomOperator support.

Heron OSS Sync Meeting

[Ning Wang]

Hi, heron devs,

The heron OSS sync meeting will be happening tomorrow at 2.00 pm PDT.
Please use the following hangout link:
https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync?authuser=0

Like we discussed earlier, updates will be communicated via email. Here are
mine:

- Shared design doc for Custom Operator for review. Here is the doc fyi:
https://docs.google.com/document/d/1XzF0IlfuaaW8Gx3cPx1xLtP-kgCFK0TRNS5aAzuMuMg/edit#
- Refactor grouping code. This will be useful in Custom Operator.
- Update heron license information.

Please reply with your updates. Thanks!


--ning

Re: Heron OSS Sync Meeting

[Ning Wang]

No objection so far.

Here are my updates:

- Discussed with Saikat about Machine Learning with Heron. We are planning
to create a new target in Apache Samoa project similar to the existing
Storm support.
- Working on user Bolt/Spout support in Streamlet API. I am stepping back a
bit and reconsider user Bolt as a Custom Operator way and see if this can
make the support more straightforward. I would like to keep the type safety
feature but it seems to be tricky.





On Mon, Sep 24, 2018 at 2:37 PM Neng Lu  wrote:

> +1 for this idea. We should utilize more of the mailing list and use it as
> the main discussion place.
>
> The sync meet should only play as a supplementary role.
>
> On Mon, Sep 24, 2018 at 2:12 PM Ning Wang  wrote:
>
> > Hi,
> >
> >
> > The heron OSS sync meeting will be happening tomorrow at 2.00 pm PDT.
> > Please use the following hangout link:
> >
> https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync?authuser=0
> >
> > There has been suggestions about communicating regular biweekly updates
> via
> > this mailing list. It could be easier for some of us to arrange time, and
> > it might be easier for discussions.
> >
> > I am thinking how about we send updates in this email thread by the end
> of
> > tomorrow and leave the sync meeting to discussions if there is any? What
> do
> > you think?
> >
>
>
> --
> Best Regards,
> Neng
>

Re: Heron OSS Sync Meeting

[Neng Lu]

+1 for this idea. We should utilize more of the mailing list and use it as
the main discussion place.

The sync meet should only play as a supplementary role.

On Mon, Sep 24, 2018 at 2:12 PM Ning Wang  wrote:

> Hi,
>
>
> The heron OSS sync meeting will be happening tomorrow at 2.00 pm PDT.
> Please use the following hangout link:
> https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync?authuser=0
>
> There has been suggestions about communicating regular biweekly updates via
> this mailing list. It could be easier for some of us to arrange time, and
> it might be easier for discussions.
>
> I am thinking how about we send updates in this email thread by the end of
> tomorrow and leave the sync meeting to discussions if there is any? What do
> you think?
>


-- 
Best Regards,
Neng

Heron OSS Sync Meeting

[Ning Wang]

Hi,


The heron OSS sync meeting will be happening tomorrow at 2.00 pm PDT.
Please use the following hangout link:
https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync?authuser=0

There has been suggestions about communicating regular biweekly updates via
this mailing list. It could be easier for some of us to arrange time, and
it might be easier for discussions.

I am thinking how about we send updates in this email thread by the end of
tomorrow and leave the sync meeting to discussions if there is any? What do
you think?

Re: Heron OSS Sync Meeting

[Josh Fischer]

+1

On Mon, Sep 10, 2018 at 12:20 PM Ning Wang  wrote:

> One thing I think we may need to discuss tomorrow is to find a replacement
> for Google hangout. We have seen some issues(cant accept requests) in the
> past a few weeks.
>
>
>
> On Mon, Sep 10, 2018 at 10:02 AM Ning Wang  wrote:
>
> > Hi,
> >
> > The heron OSS sync meeting will be happening tomorrow at 2.00 pm PDT.
> > Please use the following hangout link:
> > https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync
> > ?authuser=0
> >
> >
> > See you all then.
> >
>
-- 
Sent from A Mobile Device

Re: Heron OSS Sync Meeting

[Ning Wang]

One thing I think we may need to discuss tomorrow is to find a replacement
for Google hangout. We have seen some issues(cant accept requests) in the
past a few weeks.



On Mon, Sep 10, 2018 at 10:02 AM Ning Wang  wrote:

> Hi,
>
> The heron OSS sync meeting will be happening tomorrow at 2.00 pm PDT.
> Please use the following hangout link:
> https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync
> ?authuser=0
>
>
> See you all then.
>

Heron OSS Sync Meeting

[Ning Wang]

Hi,

The heron OSS sync meeting will be happening tomorrow at 2.00 pm PDT.
Please use the following hangout link:
https://hangouts.google.com/hangouts/_/streaml.io/oss-heron-sync?authuser=0


See you all then.

Re: Heron OSS Sync Meeting notes

[Ning Wang]

Got it. Thanks.

On Tue, Mar 27, 2018 at 6:35 PM, Dave Fisher  wrote:

> Hi Ning,
>
> If matters including that the hangout is happening were discussed on this
> mailing list then the following benefits occur.
>
> (1) Every person interested and subscribed can know the agenda.
> (2) Anyone can share any updates to the meeting url in real time.
> (3) Post Meeting Notes are kept in the open.
> (4) Apache projects are Open Source for the public good.
>
> I’m here to help Heron become an Apache project.
>
> Regards,
> Dave
>
> Sent from my iPhone
>
> > On Mar 27, 2018, at 4:51 PM, Ning Wang  wrote:
> >
> > A little more details about the hangout issue:
> >
> > Owner of hangout meeting is responsible to accept incoming requests.
> Since
> > Karthik is sick today so we had to create a new temporary meeting, which
> is
> > not ideal.
> >
> >
> >
> >> On Tue, Mar 27, 2018 at 4:09 PM, Ning Wang 
> wrote:
> >>
> >> Thanks for the suggestions.
> >>
> >> On Tue, Mar 27, 2018 at 4:02 PM, Dave Fisher 
> >> wrote:
> >>
> >>>  - Looking for another host for our Mailing list
> >>>
> >>>
> >>> The Mailing List must be dev@heron.incubator.apache.org using any
> other
> >>> mailing list is not the Apache Way.
> >>>
> >>>
> >>>  - Hangout is killing us today! We need a better solution.
> >>>
> >>>
> >>> Discuss items in plain sight of the whole community on this list. This
> >>> allows other developers to participate asynchronously.
> >>>
> >>> Regards,
> >>> Dave
> >>>
> >>>
> >>> On Mar 27, 2018, at 3:47 PM, Ning Wang  wrote:
> >>>
> >>> Hi,
> >>>
> >>> Here is a super brief notes for today's sync meeting:
> >>>
> >>>
> >>>  - Hangout is killing us today! We need a better solution.
> >>>  - Per component cpu/disk config is added but not used yet.
> >>>  - Looking into failing integration tests. This has been affecting us
> >>>  quite a big
> >>>  - New works on nomad scheduler (docker support)
> >>>  - New padding configs (to improve padding calculation and avoid hard
> >>>  coded configs) are documented and shared:
> >>>  https://docs.google.com/document/d/10JNZNYtcUIlsEyXcWWQUyh
> >>> cSoQoJZMvYrTYT8UFo4dQ/edit
> >>>  - Clean up and k8s scheduler related works ongoing
> >>>  - New scala examples have been added. Next step is to document them
> and
> >>>  integration tests
> >>>  - Looking for another host for our Mailing list
> >>>  - Code change ongoing to make the website apache ready. ETA next
> >>>  weekend. Apache Infra setup is needed for starting the website.
> >>>  - Apache transfer is on going by Twitter’s OSS team.
> >>>  - We need to finalize the meetup date @maosong.
> >>>
> >>>
> >>>
> >>>
> >>> Meeting notes are tracked here:
> >>> https://docs.google.com/document/d/1cTIBq3jOVRTSR0Zd5OKK20OqwT2l9
> >>> 0xXiY_HssVo8mE/edit?ts=5aa84932#
> >>>
> >>>
> >>>
> >>
>
>

Re: Heron OSS Sync Meeting notes

[Dave Fisher]

Hi Ning,

If matters including that the hangout is happening were discussed on this 
mailing list then the following benefits occur.

(1) Every person interested and subscribed can know the agenda.
(2) Anyone can share any updates to the meeting url in real time.
(3) Post Meeting Notes are kept in the open.
(4) Apache projects are Open Source for the public good.

I’m here to help Heron become an Apache project.

Regards,
Dave

Sent from my iPhone

> On Mar 27, 2018, at 4:51 PM, Ning Wang  wrote:
> 
> A little more details about the hangout issue:
> 
> Owner of hangout meeting is responsible to accept incoming requests. Since
> Karthik is sick today so we had to create a new temporary meeting, which is
> not ideal.
> 
> 
> 
>> On Tue, Mar 27, 2018 at 4:09 PM, Ning Wang  wrote:
>> 
>> Thanks for the suggestions.
>> 
>> On Tue, Mar 27, 2018 at 4:02 PM, Dave Fisher 
>> wrote:
>> 
>>>  - Looking for another host for our Mailing list
>>> 
>>> 
>>> The Mailing List must be dev@heron.incubator.apache.org using any other
>>> mailing list is not the Apache Way.
>>> 
>>> 
>>>  - Hangout is killing us today! We need a better solution.
>>> 
>>> 
>>> Discuss items in plain sight of the whole community on this list. This
>>> allows other developers to participate asynchronously.
>>> 
>>> Regards,
>>> Dave
>>> 
>>> 
>>> On Mar 27, 2018, at 3:47 PM, Ning Wang  wrote:
>>> 
>>> Hi,
>>> 
>>> Here is a super brief notes for today's sync meeting:
>>> 
>>> 
>>>  - Hangout is killing us today! We need a better solution.
>>>  - Per component cpu/disk config is added but not used yet.
>>>  - Looking into failing integration tests. This has been affecting us
>>>  quite a big
>>>  - New works on nomad scheduler (docker support)
>>>  - New padding configs (to improve padding calculation and avoid hard
>>>  coded configs) are documented and shared:
>>>  https://docs.google.com/document/d/10JNZNYtcUIlsEyXcWWQUyh
>>> cSoQoJZMvYrTYT8UFo4dQ/edit
>>>  - Clean up and k8s scheduler related works ongoing
>>>  - New scala examples have been added. Next step is to document them and
>>>  integration tests
>>>  - Looking for another host for our Mailing list
>>>  - Code change ongoing to make the website apache ready. ETA next
>>>  weekend. Apache Infra setup is needed for starting the website.
>>>  - Apache transfer is on going by Twitter’s OSS team.
>>>  - We need to finalize the meetup date @maosong.
>>> 
>>> 
>>> 
>>> 
>>> Meeting notes are tracked here:
>>> https://docs.google.com/document/d/1cTIBq3jOVRTSR0Zd5OKK20OqwT2l9
>>> 0xXiY_HssVo8mE/edit?ts=5aa84932#
>>> 
>>> 
>>> 
>> 

Re: Heron OSS Sync Meeting notes

[Ning Wang]

A little more details about the hangout issue:

Owner of hangout meeting is responsible to accept incoming requests. Since
Karthik is sick today so we had to create a new temporary meeting, which is
not ideal.



On Tue, Mar 27, 2018 at 4:09 PM, Ning Wang  wrote:

> Thanks for the suggestions.
>
> On Tue, Mar 27, 2018 at 4:02 PM, Dave Fisher 
> wrote:
>
>>   - Looking for another host for our Mailing list
>>
>>
>> The Mailing List must be dev@heron.incubator.apache.org using any other
>> mailing list is not the Apache Way.
>>
>>
>>   - Hangout is killing us today! We need a better solution.
>>
>>
>> Discuss items in plain sight of the whole community on this list. This
>> allows other developers to participate asynchronously.
>>
>> Regards,
>> Dave
>>
>>
>> On Mar 27, 2018, at 3:47 PM, Ning Wang  wrote:
>>
>> Hi,
>>
>> Here is a super brief notes for today's sync meeting:
>>
>>
>>   - Hangout is killing us today! We need a better solution.
>>   - Per component cpu/disk config is added but not used yet.
>>   - Looking into failing integration tests. This has been affecting us
>>   quite a big
>>   - New works on nomad scheduler (docker support)
>>   - New padding configs (to improve padding calculation and avoid hard
>>   coded configs) are documented and shared:
>>   https://docs.google.com/document/d/10JNZNYtcUIlsEyXcWWQUyh
>> cSoQoJZMvYrTYT8UFo4dQ/edit
>>   - Clean up and k8s scheduler related works ongoing
>>   - New scala examples have been added. Next step is to document them and
>>   integration tests
>>   - Looking for another host for our Mailing list
>>   - Code change ongoing to make the website apache ready. ETA next
>>   weekend. Apache Infra setup is needed for starting the website.
>>   - Apache transfer is on going by Twitter’s OSS team.
>>   - We need to finalize the meetup date @maosong.
>>
>>
>>
>>
>> Meeting notes are tracked here:
>> https://docs.google.com/document/d/1cTIBq3jOVRTSR0Zd5OKK20OqwT2l9
>> 0xXiY_HssVo8mE/edit?ts=5aa84932#
>>
>>
>>
>

Re: Heron OSS Sync Meeting notes

[Ning Wang]

Thanks for the suggestions.

On Tue, Mar 27, 2018 at 4:02 PM, Dave Fisher  wrote:

>   - Looking for another host for our Mailing list
>
>
> The Mailing List must be dev@heron.incubator.apache.org using any other
> mailing list is not the Apache Way.
>
>
>   - Hangout is killing us today! We need a better solution.
>
>
> Discuss items in plain sight of the whole community on this list. This
> allows other developers to participate asynchronously.
>
> Regards,
> Dave
>
>
> On Mar 27, 2018, at 3:47 PM, Ning Wang  wrote:
>
> Hi,
>
> Here is a super brief notes for today's sync meeting:
>
>
>   - Hangout is killing us today! We need a better solution.
>   - Per component cpu/disk config is added but not used yet.
>   - Looking into failing integration tests. This has been affecting us
>   quite a big
>   - New works on nomad scheduler (docker support)
>   - New padding configs (to improve padding calculation and avoid hard
>   coded configs) are documented and shared:
>   https://docs.google.com/document/d/10JNZNYtcUIlsEyXcWWQUyhcSoQoJZ
> MvYrTYT8UFo4dQ/edit
>   - Clean up and k8s scheduler related works ongoing
>   - New scala examples have been added. Next step is to document them and
>   integration tests
>   - Looking for another host for our Mailing list
>   - Code change ongoing to make the website apache ready. ETA next
>   weekend. Apache Infra setup is needed for starting the website.
>   - Apache transfer is on going by Twitter’s OSS team.
>   - We need to finalize the meetup date @maosong.
>
>
>
>
> Meeting notes are tracked here:
> https://docs.google.com/document/d/1cTIBq3jOVRTSR0Zd5OKK20OqwT2l9
> 0xXiY_HssVo8mE/edit?ts=5aa84932#
>
>
>

Re: Heron OSS Sync Meeting notes

[Dave Fisher]

>   - Looking for another host for our Mailing list

The Mailing List must be dev@heron.incubator.apache.org 
 using any other mailing list is not the 
Apache Way.


>   - Hangout is killing us today! We need a better solution.

Discuss items in plain sight of the whole community on this list. This allows 
other developers to participate asynchronously.

Regards,
Dave


> On Mar 27, 2018, at 3:47 PM, Ning Wang  wrote:
> 
> Hi,
> 
> Here is a super brief notes for today's sync meeting:
> 
> 
>   - Hangout is killing us today! We need a better solution.
>   - Per component cpu/disk config is added but not used yet.
>   - Looking into failing integration tests. This has been affecting us
>   quite a big
>   - New works on nomad scheduler (docker support)
>   - New padding configs (to improve padding calculation and avoid hard
>   coded configs) are documented and shared:
>   
> https://docs.google.com/document/d/10JNZNYtcUIlsEyXcWWQUyhcSoQoJZMvYrTYT8UFo4dQ/edit
>   - Clean up and k8s scheduler related works ongoing
>   - New scala examples have been added. Next step is to document them and
>   integration tests
>   - Looking for another host for our Mailing list
>   - Code change ongoing to make the website apache ready. ETA next
>   weekend. Apache Infra setup is needed for starting the website.
>   - Apache transfer is on going by Twitter’s OSS team.
>   - We need to finalize the meetup date @maosong.
> 
> 
> 
> 
> Meeting notes are tracked here:
> https://docs.google.com/document/d/1cTIBq3jOVRTSR0Zd5OKK20OqwT2l9
> 0xXiY_HssVo8mE/edit?ts=5aa84932#



signature.asc
Description: Message signed with OpenPGP