CI failures

2018-04-13 Thread Marco de Abreu
Hello everybody,

I just wanted to inform you that there have been a few hiccups in our CI
system which might have lead to some of your PRs failing. I tried to
re-trigger the ones I saw, but please feel free to make an empty commit to
do it yourself.

To give some background: This is caused by our Dockercache on Ubuntu CPU
instances not being properly purged due to the high number of Dockerfile
changes. As of now, Jenkins already detects this ahead of time and
disconnects the slaves, but this results in resource starvation and faulty
slaves. For the time being, I have redeployed all Ubuntu CPU slaves and
increased the disk size from 350GB to 550GB.

I'm currently working on the auto scaling project for our CI, which will
also introduce a new set of slaves with a new architecture. These slaves
will have a proper purge job and this problem should not come up again
after deploying them to production. In case precautions like these fail,
our systems will automatically detect faulty or degrading slaves and remove
them from the running system without impairing running builds as well
making sure they're getting replaced.

Considering it's only a few more weeks until the expected roll-out, I've
taken the liberty to focus my time on the development of that project and
decided to leave the slaves as they are for now. In future, this
house-keeping will be completely automatized.

Best regards,
Marco


Re: data.mxnet.io is gone (correction)

2018-04-13 Thread Mu Li
Up now. (The EBS volume was unmounted.) I'll move all data into S3

On Fri, Apr 13, 2018 at 11:51 AM, Aaron Markham 
wrote:

> So anyone know what happened? It's a critical resource for datasets
> and examples and more... and all the files seem gone.
>
> http://data.mxnet.io/
> That's show forbidden... which is unusual.
>
> Then any resource like
> http://data.mxnet.io/models/imagenet/squeezenet/ is missing.
>


data.mxnet.io is gone (correction)

2018-04-13 Thread Aaron Markham
So anyone know what happened? It's a critical resource for datasets
and examples and more... and all the files seem gone.

http://data.mxnet.io/
That's show forbidden... which is unusual.

Then any resource like
http://data.mxnet.io/models/imagenet/squeezenet/ is missing.


mxnet.data.io is gone!?

2018-04-13 Thread Aaron Markham
So anyone know what happened? It's a critical resource for datasets
and examples and more... and all the files seem gone.

http://data.mxnet.io/
That's show forbidden... which is unusual.

Then any resource like
http://data.mxnet.io/models/imagenet/squeezenet/ is missing.


Re: blog for MXNet

2018-04-13 Thread Hen
Pretty sad that “intel mkdnn mxnet” doesn’t find that in a google search;
but perhaps that says more about the fragmentation of the internet and my
out of date expectations :)

Is that being translated over to English (recognizing the assumption that
western developers speak English)?

On Wed, Apr 11, 2018 at 8:02 PM Yida Wang  wrote:

> We have a WeChat official account ApacheMXNet and this is the latest post:
>
> https://mp.weixin.qq.com/s?__biz=MzU3NjUyOTU0OA==&mid=2247483669&idx=1&sn=f6217700a69c3d70a91593560b94fd42&chksm=fd1334f6ca64bde07e4d9271fb549b897996c8638f061bea545b7ab19fb10d0c31973f3544e8#rd
>
> Yida
>
> On Wed, Apr 11, 2018 at 7:55 PM, Aaron Markham 
> wrote:
>
> > I think for China we need to cross-post to WeChat. Apparently, there
> > is already blog post activity for MXNet there, and it would make sense
> > to be on that platform directly.
> >
> > Can a China user access the Apache blog site that Hen mentioned? Also,
> > I'm not familiar with the Apache blog and how you contribute. I don't
> > see info about it on Confluence or elsewhere. Certainly sounds like
> > something that needs some attention and to be part of regular
> > communications.
> >
> >
> > On Wed, Apr 11, 2018 at 6:21 PM, Zhao, Patric 
> > wrote:
> > > FYI, China user can't access medium.com :(
> > >
> > >> -Original Message-
> > >> From: Anirudh Acharya [mailto:anirudhk...@gmail.com]
> > >> Sent: Thursday, April 12, 2018 6:31 AM
> > >> To: dev@mxnet.incubator.apache.org
> > >> Subject: Re: blog for MXNet
> > >>
> > >> There is already an AWS Evangelist, Julien Simon, who has quite a few
> > posts
> > >> about mxnet/gluon on medium - https://medium.com/@julsimon
> > >>
> > >>
> > >> Regards
> > >> Anirudh
> > >>
> > >> On Wed, Apr 11, 2018 at 3:27 PM, Sebastian Gutierrez <
> > >> sebast...@aiworkbox.com> wrote:
> > >>
> > >> > Aaron and Thomas
> > >> >
> > >> > Great ideas!
> > >> >
> > >> > One thing worth also considering is something like
> > >> >
> > >> > https://www.r-bloggers.com/
> > >> >
> > >> > What it does is serve as a blog aggregation service for all of the
> > >> > people who have blogged about r topics. Because of the central
> > >> > repository nature, it serves as a natural gathering point and allows
> > >> > people not using RSS (or similar technologies) to keep up to date
> > with what is
> > >> happening.
> > >> >
> > >> > Another thing worth considering is a job board / site for MXNet full
> > >> > time / part time / remote jobs.  The data vis community has this
> free
> > >> > email list service
> > >> > https://groups.google.com/forum/m/#!forum/data-vis-jobs that's very
> > >> > community friendly and is a good place for people to gather to see
> job
> > >> > needs.
> > >> >
> > >> > All the best
> > >> > Sebastian Gutierrez
> > >> >
> > >> >
> > >> > On Wed, Apr 11, 2018 at 6:10 PM Thomas DELTEIL
> > >> > 
> > >> > wrote:
> > >> >
> > >> > > Thanks Aaron, I like medium, a lot of projects seems to be posting
> > >> > > their articles there, as you mentioned.
> > >> > >
> > >> > > Note that there is a newly created Chinese MXNet blog here:
> > >> > > https://zh.mxnet.io/blog/
> > >> > >
> > >> > > I would be happy to contribute to the blogs, if you want to add me
> > >> > > to the writer/editor list.
> > >> > >
> > >> > >
> > >> > >
> > >> > > Also, there is a mxnet subreddit r/mxnet which was created by
> > >> > > Sebastian
> > >> > > (thanks!) and I am now a moderator as well. Feel free to
> cross-post
> > >> > > any interesting content there! https://www.reddit.com/r/mxnet/
> > >> > > Please subscribe!
> > >> > >
> > >> > >
> > >> > > I will try to post one link a day at least, until I run out of
> links
> > >> > > ☺ We will also improve the look of it this week and add links to
> > >> > > relevant resources on the side bar, etc.
> > >> > >
> > >> > >
> > >> > >
> > >> > > All the best,
> > >> > >
> > >> > >
> > >> > > Thomas
> > >> > >
> > >> > >
> > >> > > 2018-04-11 14:45 GMT-07:00 Aaron Markham
> > >> :
> > >> > >
> > >> > > > Having a blog for MXNet would be very useful for conveying news,
> > >> > > > talking about features, demoing applications, and building
> > awareness.
> > >> > > >
> > >> > > > Does anyone have particular preferences or recommendations on
> blog
> > >> > > > hosting or platform?
> > >> > > >
> > >> > > > I currently have editor access for an MXNet branded account on
> > Medium.
> > >> > > > https://medium.com/mxnet
> > >> > > >
> > >> > > > There's nothing there at the moment, but at least with Medium we
> > >> > > > all could get started right away, and have a built-in
> syndication
> > >> > > > platform. Also, note that this is where the TensorFlow blog
> > resides:
> > >> > > > https://medium.com/tensorflow
> > >> > > >
> > >> > > > Please make it known if you'd like to contribute, so you can get
> > >> > > > writer/editor access (to whichever platform we settle on.)
> > >> > > >
> > >> > > > Cheers,
> > >> > > > Aaron
> > >> > > >
> > >> > >
> > >> >
> >
>


Re: Quick question about a submodule file’s license

2018-04-13 Thread Hen
There’s nothing special process-wise; subscribe to the list and email the
question. The more detail and links the better to avoid any
misunderstandings.

Hen

On Fri, Apr 6, 2018 at 11:43 AM Meghna Baijal 
wrote:

> Thank you Henri, Pedro.
> Yes, we are only referring to the one documentation file within google
> test.
>
> Henri,
> Could you please guide me on the best approach to take an issue to the
> legal-discuss@.
>
> Thanks,
> Meghna Baijal
>
> On Fri, Apr 6, 2018 at 7:42 AM, Pedro Larroy  >
> wrote:
>
> > Good point, I thought text is media, but I'm not a lawyer. Just to be
> > clear, that this refers to that particular documentation file, the
> software
> > is BSD licensed.
> >
> > Pedro.
> >
> > On Fri, Apr 6, 2018 at 9:41 AM, Hen  wrote:
> >
> > > Noting that the linked FAQ is for CC-BY-SA and unmodified media (ie:
> > > images, sound, video); so it's not relevant.
> > >
> > > I think this is worth raising on legal-discuss@. CC-BY software is an
> > > issue, but resolved.html hasn't stated anything regarding CC-BY for a
> > > documentation file.
> > >
> > > Hen
> > >
> > > On Thu, Apr 5, 2018 at 10:43 AM, Meghna Baijal <
> > meghnabaijal2...@gmail.com
> > > >
> > > wrote:
> > >
> > > > Thank you Pedro for looking into this. The suggestion came from PMC
> > > during
> > > > 1.1 voting cycle.
> > > > However, the link does seem to indicate that including it should be
> > ok. I
> > > > also found other Apache projects that have included this file.
> > > >
> > > > I will review the LICENSE and NOTICE requirements and let the file
> > remain
> > > > in the source.
> > > >
> > > > Thanks Again!
> > > >
> > > > On Thu, Apr 5, 2018 at 9:22 AM, Pedro Larroy <
> > > pedro.larroy.li...@gmail.com
> > > > >
> > > > wrote:
> > > >
> > > > > Hi Meghna.
> > > > >
> > > > > Are you sure the DevGuide of googletest is a problem?
> > > > >
> > > > > Check this out:
> > > > >
> > > > > https://www.apache.org/legal/resolved.html#cc-sa
> > > > >
> > > > >
> > > > > Pedro.
> > > > >
> > > > >
> > > > > On Thu, Apr 5, 2018 at 2:59 AM, Meghna Baijal <
> > > > meghnabaijal2...@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Hello Everyone,
> > > > > > There was a suggestion during the 1.1 release vote to remove this
> > > file
> > > > > [1]
> > > > > > from the released source since it is licensed under CC-BY-2.5.
> > > > > >
> > > > > > However, this file is a part of the googletest submodule and
> can’t
> > > > simply
> > > > > > be removed. Does anyone know how we can deal with the licensing
> of
> > > this
> > > > > > file ?
> > > > > >
> > > > > > [1] *Path to file in mxnet -*
> > > > > > apache-mxnet-src-1.1.0.rc1-incubating/3rdparty/
> > > > > googletest/googlemock/docs/
> > > > > > DevGuide.md
> > > > > > [2] *Link to github issue* :
> > > > > > https://github.com/apache/incubator-mxnet/issues/10330
> > > > > >
> > > > > > Thanks,
> > > > > > Meghna
> > > > > >
> > > > >
> > > >
> > >
> >
>