Re: project dependencies - important

[Thomas Weise]

There are a few forks of the source out there and they could be hosted on
github. It would be even better to add respective tutorials to the Apex
docs under https://github.com/apache/apex-core/tree/master/docs


On Fri, May 4, 2018 at 9:08 PM, Munagala Ramanath <
amberar...@yahoo.com.invalid> wrote:

>  Similarly, some links at http://apex.apache.org/docs.html are now broken
> (for example http://docs.datatorrent.com/tutorials/topnwords/ and
> http://docs.datatorrent.com/beginner/)
> It would be useful if such content could be rehosted elsewhere.
> Ram
> On Thursday, May 3, 2018, 9:46:04 AM PDT, Thomas Weise 
> wrote:
>
>  Pramod,
>
> There are several Apex related blogs on the DT web site that are referenced
> from http://apex.apache.org/docs.html (there are probably a few more, but
> that should be easy to identify).
>
> Would it be possible to export that subset (for example by saving as full
> page html) and check them into another github with ASL license? This way
> they would remain available to users and we could continue to reference
> them.
>
> Thanks
>
>
> On Thu, May 3, 2018 at 6:27 AM, Pramod Immaneni 
> wrote:
>
> > There may be copyright issues to deal with in case of a move.
> >
> > Thanks
> >
> > On Wed, May 2, 2018 at 10:22 PM, Vlad Rozov  wrote:
> >
> > > For netlet we can either move it to apex-core (it will require package
> > > name change and major version update) or keep it in public github
> > > repository. Other libraries are available on maven central and I see
> that
> > > you already open a PR (+1).
> > >
> > > Thank you,
> > >
> > > Vlad
> > >
> > >
> > > On 5/2/18 19:38, Thomas Weise wrote:
> > >
> > >> That one is not needed and I think we can nuke the zmq operator also.
> > >>
> > >> R has an example, so we might want to find a way to keep that alive.
> > >>
> > >>
> > >> On Wed, May 2, 2018 at 7:33 PM, Pramod Immaneni <
> pra...@datatorrent.com
> > >
> > >> wrote:
> > >>
> > >> I see a kafka 0.7.1. Not sure if it is still being used.
> > >>>
> > >>> Thanks
> > >>>
> > >>> On Wed, May 2, 2018 at 7:05 PM, Thomas Weise  wrote:
> > >>>
> > >>> Hi Pramod,
> > 
> >  Thanks for the headsup.
> > 
> >  Do you have the list of malhar dependencies that live in the DT
> > server?
> > 
> >  I remember R and zmq, anything else?
> > 
> >  Thanks,
> >  Thomas
> > 
> > 
> >  On Wed, May 2, 2018 at 6:53 PM, Pramod Immaneni <
> > pra...@datatorrent.com
> >  >
> >  wrote:
> > 
> >  Hello Community,
> > >
> > > As you may know, DataTorrent was the original developer and initial
> > > contributor of Apex. There are a couple of dependencies the project
> > >
> >  still
> > >>>
> >  has on DataTorrent.
> > >
> > > One of them is the project netlet, hosted in DataTorrent github,
> that
> > > provides a networking library for data transfer. Second, malhar
> > depends
> > > on thirdparty maven artifacts hosted on DataTorrent maven server.
> > Going
> > > forward, DataTorrent will no longer be hosting these resources.
> > >
> > > The netlet repository has been transferred to
> > > https://github.com/dtpublic/netlet which is a general account
> > >
> >  unrelated
> > >>>
> >  to
> > 
> > > DataTorrent org. This project can also be brought into apex if we
> > think
> > > that would be best for the library and the apex project.
> > >
> > > There are a small number of custom maven artifacts under
> > > https://www.datatorrent.com/maven/content/repositories/thirdparty/
> .
> > A
> > >
> >  new
> > 
> > > home needs to be found for these or malhar changed to not depend on
> > >
> >  these.
> > 
> > > The maven server will be shutdown tomorrow. One idea for the
> > immediate
> > >
> >  need
> > 
> > > is to temporarily store these under apex-site.
> > >
> > > Thanks
> > >
> > >
> > >
> >
>
>

Re: project dependencies - important

[Munagala Ramanath]

 Similarly, some links at http://apex.apache.org/docs.html are now broken (for 
example http://docs.datatorrent.com/tutorials/topnwords/ and 
http://docs.datatorrent.com/beginner/)
It would be useful if such content could be rehosted elsewhere.
Ram
On Thursday, May 3, 2018, 9:46:04 AM PDT, Thomas Weise  
wrote:  
 
 Pramod,

There are several Apex related blogs on the DT web site that are referenced
from http://apex.apache.org/docs.html (there are probably a few more, but
that should be easy to identify).

Would it be possible to export that subset (for example by saving as full
page html) and check them into another github with ASL license? This way
they would remain available to users and we could continue to reference
them.

Thanks


On Thu, May 3, 2018 at 6:27 AM, Pramod Immaneni 
wrote:

> There may be copyright issues to deal with in case of a move.
>
> Thanks
>
> On Wed, May 2, 2018 at 10:22 PM, Vlad Rozov  wrote:
>
> > For netlet we can either move it to apex-core (it will require package
> > name change and major version update) or keep it in public github
> > repository. Other libraries are available on maven central and I see that
> > you already open a PR (+1).
> >
> > Thank you,
> >
> > Vlad
> >
> >
> > On 5/2/18 19:38, Thomas Weise wrote:
> >
> >> That one is not needed and I think we can nuke the zmq operator also.
> >>
> >> R has an example, so we might want to find a way to keep that alive.
> >>
> >>
> >> On Wed, May 2, 2018 at 7:33 PM, Pramod Immaneni  >
> >> wrote:
> >>
> >> I see a kafka 0.7.1. Not sure if it is still being used.
> >>>
> >>> Thanks
> >>>
> >>> On Wed, May 2, 2018 at 7:05 PM, Thomas Weise  wrote:
> >>>
> >>> Hi Pramod,
> 
>  Thanks for the headsup.
> 
>  Do you have the list of malhar dependencies that live in the DT
> server?
> 
>  I remember R and zmq, anything else?
> 
>  Thanks,
>  Thomas
> 
> 
>  On Wed, May 2, 2018 at 6:53 PM, Pramod Immaneni <
> pra...@datatorrent.com
>  >
>  wrote:
> 
>  Hello Community,
> >
> > As you may know, DataTorrent was the original developer and initial
> > contributor of Apex. There are a couple of dependencies the project
> >
>  still
> >>>
>  has on DataTorrent.
> >
> > One of them is the project netlet, hosted in DataTorrent github, that
> > provides a networking library for data transfer. Second, malhar
> depends
> > on thirdparty maven artifacts hosted on DataTorrent maven server.
> Going
> > forward, DataTorrent will no longer be hosting these resources.
> >
> > The netlet repository has been transferred to
> > https://github.com/dtpublic/netlet which is a general account
> >
>  unrelated
> >>>
>  to
> 
> > DataTorrent org. This project can also be brought into apex if we
> think
> > that would be best for the library and the apex project.
> >
> > There are a small number of custom maven artifacts under
> > https://www.datatorrent.com/maven/content/repositories/thirdparty/.
> A
> >
>  new
> 
> > home needs to be found for these or malhar changed to not depend on
> >
>  these.
> 
> > The maven server will be shutdown tomorrow. One idea for the
> immediate
> >
>  need
> 
> > is to temporarily store these under apex-site.
> >
> > Thanks
> >
> >
> >
>
  

Re: project dependencies - important

[P. Taylor Goetz]

Note that any code/content not previously donated by DT (i.e. covered by an 
SGA) would have to go through the IP clearance process [1] [2].

-Taylor

[1] https://incubator.apache.org/guides/ip_clearance.html 

[2] http://incubator.apache.org/ip-clearance/ 




> On May 3, 2018, at 12:45 PM, Thomas Weise  wrote:
> 
> Pramod,
> 
> There are several Apex related blogs on the DT web site that are referenced
> from http://apex.apache.org/docs.html (there are probably a few more, but
> that should be easy to identify).
> 
> Would it be possible to export that subset (for example by saving as full
> page html) and check them into another github with ASL license? This way
> they would remain available to users and we could continue to reference
> them.
> 
> Thanks
> 
> 
> On Thu, May 3, 2018 at 6:27 AM, Pramod Immaneni 
> wrote:
> 
>> There may be copyright issues to deal with in case of a move.
>> 
>> Thanks
>> 
>> On Wed, May 2, 2018 at 10:22 PM, Vlad Rozov  wrote:
>> 
>>> For netlet we can either move it to apex-core (it will require package
>>> name change and major version update) or keep it in public github
>>> repository. Other libraries are available on maven central and I see that
>>> you already open a PR (+1).
>>> 
>>> Thank you,
>>> 
>>> Vlad
>>> 
>>> 
>>> On 5/2/18 19:38, Thomas Weise wrote:
>>> 
 That one is not needed and I think we can nuke the zmq operator also.
 
 R has an example, so we might want to find a way to keep that alive.
 
 
 On Wed, May 2, 2018 at 7:33 PM, Pramod Immaneni >> 
 wrote:
 
 I see a kafka 0.7.1. Not sure if it is still being used.
> 
> Thanks
> 
> On Wed, May 2, 2018 at 7:05 PM, Thomas Weise  wrote:
> 
> Hi Pramod,
>> 
>> Thanks for the headsup.
>> 
>> Do you have the list of malhar dependencies that live in the DT
>> server?
>> 
>> I remember R and zmq, anything else?
>> 
>> Thanks,
>> Thomas
>> 
>> 
>> On Wed, May 2, 2018 at 6:53 PM, Pramod Immaneni <
>> pra...@datatorrent.com
>>> 
>> wrote:
>> 
>> Hello Community,
>>> 
>>> As you may know, DataTorrent was the original developer and initial
>>> contributor of Apex. There are a couple of dependencies the project
>>> 
>> still
> 
>> has on DataTorrent.
>>> 
>>> One of them is the project netlet, hosted in DataTorrent github, that
>>> provides a networking library for data transfer. Second, malhar
>> depends
>>> on thirdparty maven artifacts hosted on DataTorrent maven server.
>> Going
>>> forward, DataTorrent will no longer be hosting these resources.
>>> 
>>> The netlet repository has been transferred to
>>> https://github.com/dtpublic/netlet which is a general account
>>> 
>> unrelated
> 
>> to
>> 
>>> DataTorrent org. This project can also be brought into apex if we
>> think
>>> that would be best for the library and the apex project.
>>> 
>>> There are a small number of custom maven artifacts under
>>> https://www.datatorrent.com/maven/content/repositories/thirdparty/.
>> A
>>> 
>> new
>> 
>>> home needs to be found for these or malhar changed to not depend on
>>> 
>> these.
>> 
>>> The maven server will be shutdown tomorrow. One idea for the
>> immediate
>>> 
>> need
>> 
>>> is to temporarily store these under apex-site.
>>> 
>>> Thanks
>>> 
>>> 
>>> 
>> 



signature.asc
Description: Message signed with OpenPGP

Re: project dependencies - important

[Thomas Weise]

Pramod,

There are several Apex related blogs on the DT web site that are referenced
from http://apex.apache.org/docs.html (there are probably a few more, but
that should be easy to identify).

Would it be possible to export that subset (for example by saving as full
page html) and check them into another github with ASL license? This way
they would remain available to users and we could continue to reference
them.

Thanks


On Thu, May 3, 2018 at 6:27 AM, Pramod Immaneni 
wrote:

> There may be copyright issues to deal with in case of a move.
>
> Thanks
>
> On Wed, May 2, 2018 at 10:22 PM, Vlad Rozov  wrote:
>
> > For netlet we can either move it to apex-core (it will require package
> > name change and major version update) or keep it in public github
> > repository. Other libraries are available on maven central and I see that
> > you already open a PR (+1).
> >
> > Thank you,
> >
> > Vlad
> >
> >
> > On 5/2/18 19:38, Thomas Weise wrote:
> >
> >> That one is not needed and I think we can nuke the zmq operator also.
> >>
> >> R has an example, so we might want to find a way to keep that alive.
> >>
> >>
> >> On Wed, May 2, 2018 at 7:33 PM, Pramod Immaneni  >
> >> wrote:
> >>
> >> I see a kafka 0.7.1. Not sure if it is still being used.
> >>>
> >>> Thanks
> >>>
> >>> On Wed, May 2, 2018 at 7:05 PM, Thomas Weise  wrote:
> >>>
> >>> Hi Pramod,
> 
>  Thanks for the headsup.
> 
>  Do you have the list of malhar dependencies that live in the DT
> server?
> 
>  I remember R and zmq, anything else?
> 
>  Thanks,
>  Thomas
> 
> 
>  On Wed, May 2, 2018 at 6:53 PM, Pramod Immaneni <
> pra...@datatorrent.com
>  >
>  wrote:
> 
>  Hello Community,
> >
> > As you may know, DataTorrent was the original developer and initial
> > contributor of Apex. There are a couple of dependencies the project
> >
>  still
> >>>
>  has on DataTorrent.
> >
> > One of them is the project netlet, hosted in DataTorrent github, that
> > provides a networking library for data transfer. Second, malhar
> depends
> > on thirdparty maven artifacts hosted on DataTorrent maven server.
> Going
> > forward, DataTorrent will no longer be hosting these resources.
> >
> > The netlet repository has been transferred to
> > https://github.com/dtpublic/netlet which is a general account
> >
>  unrelated
> >>>
>  to
> 
> > DataTorrent org. This project can also be brought into apex if we
> think
> > that would be best for the library and the apex project.
> >
> > There are a small number of custom maven artifacts under
> > https://www.datatorrent.com/maven/content/repositories/thirdparty/.
> A
> >
>  new
> 
> > home needs to be found for these or malhar changed to not depend on
> >
>  these.
> 
> > The maven server will be shutdown tomorrow. One idea for the
> immediate
> >
>  need
> 
> > is to temporarily store these under apex-site.
> >
> > Thanks
> >
> >
> >
>

Re: project dependencies - important

[Pramod Immaneni]

There may be copyright issues to deal with in case of a move.

Thanks

On Wed, May 2, 2018 at 10:22 PM, Vlad Rozov  wrote:

> For netlet we can either move it to apex-core (it will require package
> name change and major version update) or keep it in public github
> repository. Other libraries are available on maven central and I see that
> you already open a PR (+1).
>
> Thank you,
>
> Vlad
>
>
> On 5/2/18 19:38, Thomas Weise wrote:
>
>> That one is not needed and I think we can nuke the zmq operator also.
>>
>> R has an example, so we might want to find a way to keep that alive.
>>
>>
>> On Wed, May 2, 2018 at 7:33 PM, Pramod Immaneni 
>> wrote:
>>
>> I see a kafka 0.7.1. Not sure if it is still being used.
>>>
>>> Thanks
>>>
>>> On Wed, May 2, 2018 at 7:05 PM, Thomas Weise  wrote:
>>>
>>> Hi Pramod,

 Thanks for the headsup.

 Do you have the list of malhar dependencies that live in the DT server?

 I remember R and zmq, anything else?

 Thanks,
 Thomas


 On Wed, May 2, 2018 at 6:53 PM, Pramod Immaneni 
 wrote:

 Hello Community,
>
> As you may know, DataTorrent was the original developer and initial
> contributor of Apex. There are a couple of dependencies the project
>
 still
>>>
 has on DataTorrent.
>
> One of them is the project netlet, hosted in DataTorrent github, that
> provides a networking library for data transfer. Second, malhar depends
> on thirdparty maven artifacts hosted on DataTorrent maven server. Going
> forward, DataTorrent will no longer be hosting these resources.
>
> The netlet repository has been transferred to
> https://github.com/dtpublic/netlet which is a general account
>
 unrelated
>>>
 to

> DataTorrent org. This project can also be brought into apex if we think
> that would be best for the library and the apex project.
>
> There are a small number of custom maven artifacts under
> https://www.datatorrent.com/maven/content/repositories/thirdparty/. A
>
 new

> home needs to be found for these or malhar changed to not depend on
>
 these.

> The maven server will be shutdown tomorrow. One idea for the immediate
>
 need

> is to temporarily store these under apex-site.
>
> Thanks
>
>
>

Re: project dependencies - important

[Vlad Rozov]

For netlet we can either move it to apex-core (it will require package 
name change and major version update) or keep it in public github 
repository. Other libraries are available on maven central and I see 
that you already open a PR (+1).


Thank you,

Vlad

On 5/2/18 19:38, Thomas Weise wrote:

That one is not needed and I think we can nuke the zmq operator also.

R has an example, so we might want to find a way to keep that alive.


On Wed, May 2, 2018 at 7:33 PM, Pramod Immaneni 
wrote:


I see a kafka 0.7.1. Not sure if it is still being used.

Thanks

On Wed, May 2, 2018 at 7:05 PM, Thomas Weise  wrote:


Hi Pramod,

Thanks for the headsup.

Do you have the list of malhar dependencies that live in the DT server?

I remember R and zmq, anything else?

Thanks,
Thomas


On Wed, May 2, 2018 at 6:53 PM, Pramod Immaneni 
wrote:


Hello Community,

As you may know, DataTorrent was the original developer and initial
contributor of Apex. There are a couple of dependencies the project

still

has on DataTorrent.

One of them is the project netlet, hosted in DataTorrent github, that
provides a networking library for data transfer. Second, malhar depends
on thirdparty maven artifacts hosted on DataTorrent maven server. Going
forward, DataTorrent will no longer be hosting these resources.

The netlet repository has been transferred to
https://github.com/dtpublic/netlet which is a general account

unrelated

to

DataTorrent org. This project can also be brought into apex if we think
that would be best for the library and the apex project.

There are a small number of custom maven artifacts under
https://www.datatorrent.com/maven/content/repositories/thirdparty/. A

new

home needs to be found for these or malhar changed to not depend on

these.

The maven server will be shutdown tomorrow. One idea for the immediate

need

is to temporarily store these under apex-site.

Thanks

Re: project dependencies - important

[Thomas Weise]

https://github.com/apache/apex-malhar/pull/685

Dependencies available from elsewhere.

On Wed, May 2, 2018 at 7:38 PM, Thomas Weise  wrote:

> That one is not needed and I think we can nuke the zmq operator also.
>
> R has an example, so we might want to find a way to keep that alive.
>
>
> On Wed, May 2, 2018 at 7:33 PM, Pramod Immaneni 
> wrote:
>
>> I see a kafka 0.7.1. Not sure if it is still being used.
>>
>> Thanks
>>
>> On Wed, May 2, 2018 at 7:05 PM, Thomas Weise  wrote:
>>
>> > Hi Pramod,
>> >
>> > Thanks for the headsup.
>> >
>> > Do you have the list of malhar dependencies that live in the DT server?
>> >
>> > I remember R and zmq, anything else?
>> >
>> > Thanks,
>> > Thomas
>> >
>> >
>> > On Wed, May 2, 2018 at 6:53 PM, Pramod Immaneni > >
>> > wrote:
>> >
>> > > Hello Community,
>> > >
>> > > As you may know, DataTorrent was the original developer and initial
>> > > contributor of Apex. There are a couple of dependencies the project
>> still
>> > > has on DataTorrent.
>> > >
>> > > One of them is the project netlet, hosted in DataTorrent github, that
>> > > provides a networking library for data transfer. Second, malhar
>> depends
>> > > on thirdparty maven artifacts hosted on DataTorrent maven server.
>> Going
>> > > forward, DataTorrent will no longer be hosting these resources.
>> > >
>> > > The netlet repository has been transferred to
>> > > https://github.com/dtpublic/netlet which is a general account
>> unrelated
>> > to
>> > > DataTorrent org. This project can also be brought into apex if we
>> think
>> > > that would be best for the library and the apex project.
>> > >
>> > > There are a small number of custom maven artifacts under
>> > > https://www.datatorrent.com/maven/content/repositories/thirdparty/. A
>> > new
>> > > home needs to be found for these or malhar changed to not depend on
>> > these.
>> > > The maven server will be shutdown tomorrow. One idea for the immediate
>> > need
>> > > is to temporarily store these under apex-site.
>> > >
>> > > Thanks
>> > >
>> >
>>
>
>

Re: project dependencies - important

[Thomas Weise]

That one is not needed and I think we can nuke the zmq operator also.

R has an example, so we might want to find a way to keep that alive.


On Wed, May 2, 2018 at 7:33 PM, Pramod Immaneni 
wrote:

> I see a kafka 0.7.1. Not sure if it is still being used.
>
> Thanks
>
> On Wed, May 2, 2018 at 7:05 PM, Thomas Weise  wrote:
>
> > Hi Pramod,
> >
> > Thanks for the headsup.
> >
> > Do you have the list of malhar dependencies that live in the DT server?
> >
> > I remember R and zmq, anything else?
> >
> > Thanks,
> > Thomas
> >
> >
> > On Wed, May 2, 2018 at 6:53 PM, Pramod Immaneni 
> > wrote:
> >
> > > Hello Community,
> > >
> > > As you may know, DataTorrent was the original developer and initial
> > > contributor of Apex. There are a couple of dependencies the project
> still
> > > has on DataTorrent.
> > >
> > > One of them is the project netlet, hosted in DataTorrent github, that
> > > provides a networking library for data transfer. Second, malhar depends
> > > on thirdparty maven artifacts hosted on DataTorrent maven server. Going
> > > forward, DataTorrent will no longer be hosting these resources.
> > >
> > > The netlet repository has been transferred to
> > > https://github.com/dtpublic/netlet which is a general account
> unrelated
> > to
> > > DataTorrent org. This project can also be brought into apex if we think
> > > that would be best for the library and the apex project.
> > >
> > > There are a small number of custom maven artifacts under
> > > https://www.datatorrent.com/maven/content/repositories/thirdparty/. A
> > new
> > > home needs to be found for these or malhar changed to not depend on
> > these.
> > > The maven server will be shutdown tomorrow. One idea for the immediate
> > need
> > > is to temporarily store these under apex-site.
> > >
> > > Thanks
> > >
> >
>

Re: project dependencies - important

[Pramod Immaneni]

I see a kafka 0.7.1. Not sure if it is still being used.

Thanks

On Wed, May 2, 2018 at 7:05 PM, Thomas Weise  wrote:

> Hi Pramod,
>
> Thanks for the headsup.
>
> Do you have the list of malhar dependencies that live in the DT server?
>
> I remember R and zmq, anything else?
>
> Thanks,
> Thomas
>
>
> On Wed, May 2, 2018 at 6:53 PM, Pramod Immaneni 
> wrote:
>
> > Hello Community,
> >
> > As you may know, DataTorrent was the original developer and initial
> > contributor of Apex. There are a couple of dependencies the project still
> > has on DataTorrent.
> >
> > One of them is the project netlet, hosted in DataTorrent github, that
> > provides a networking library for data transfer. Second, malhar depends
> > on thirdparty maven artifacts hosted on DataTorrent maven server. Going
> > forward, DataTorrent will no longer be hosting these resources.
> >
> > The netlet repository has been transferred to
> > https://github.com/dtpublic/netlet which is a general account unrelated
> to
> > DataTorrent org. This project can also be brought into apex if we think
> > that would be best for the library and the apex project.
> >
> > There are a small number of custom maven artifacts under
> > https://www.datatorrent.com/maven/content/repositories/thirdparty/. A
> new
> > home needs to be found for these or malhar changed to not depend on
> these.
> > The maven server will be shutdown tomorrow. One idea for the immediate
> need
> > is to temporarily store these under apex-site.
> >
> > Thanks
> >
>

Re: project dependencies - important

[Thomas Weise]

Hi Pramod,

Thanks for the headsup.

Do you have the list of malhar dependencies that live in the DT server?

I remember R and zmq, anything else?

Thanks,
Thomas


On Wed, May 2, 2018 at 6:53 PM, Pramod Immaneni 
wrote:

> Hello Community,
>
> As you may know, DataTorrent was the original developer and initial
> contributor of Apex. There are a couple of dependencies the project still
> has on DataTorrent.
>
> One of them is the project netlet, hosted in DataTorrent github, that
> provides a networking library for data transfer. Second, malhar depends
> on thirdparty maven artifacts hosted on DataTorrent maven server. Going
> forward, DataTorrent will no longer be hosting these resources.
>
> The netlet repository has been transferred to
> https://github.com/dtpublic/netlet which is a general account unrelated to
> DataTorrent org. This project can also be brought into apex if we think
> that would be best for the library and the apex project.
>
> There are a small number of custom maven artifacts under
> https://www.datatorrent.com/maven/content/repositories/thirdparty/. A new
> home needs to be found for these or malhar changed to not depend on these.
> The maven server will be shutdown tomorrow. One idea for the immediate need
> is to temporarily store these under apex-site.
>
> Thanks
>