Re: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto
On 11/20/19 11:56 AM, Mauro Ziliani wrote: Is it possible to compile tensorflow against python2.7? I doubt that it's easy/supported but Hongxu, who lives in China, will reply later today to explain. Btw, Krogoth has python3, why not use it? ../Randy Il 20/11/19 16:40, Mauro Ziliani ha scritto: I forked the repository and I'm tryng to port the layer for Krogoth M Il 20/11/19 15:37, Mauro Ziliani ha scritto: Hi all. There a port for meta-tensorflow for Krogoth or Sumo? Mayabe I need to use it on this distribution Thaks M Il 21/02/19 12:37, Hongxu Jia ha scritto: Hi RP and Yocto folks, Currently AI on IoT edge becomes more and more popular, but there is no machine learning framework in Yocto/OE. With the support of Eric , Robert and Randy, after two months effort, I've integrated TensorFlow to Yocto. Now, I contribute the patches to Yocto for review, and apply for creating a layer named `meta-tensorflow' on Yocto. For test convenient, there is a fork on github: https://github.com/hongxu-jia/meta-tensorflow BTW, I have contributed other 11 fundamental recipes to meta-openembedded and all of them have been merged to master branch. Please no hesitate to share your suggestion. //Hongxu Testing Commands: - See README Testing, Expected Results: -- See README -- # Randy MacLeod # Wind River Linux -- ___ yocto mailing list yocto@yoctoproject.org https://lists.yoctoproject.org/listinfo/yocto
Re: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto
Is it possible to compile tensorflow against python2.7? Il 20/11/19 16:40, Mauro Ziliani ha scritto: I forked the repository and I'm tryng to port the layer for Krogoth M Il 20/11/19 15:37, Mauro Ziliani ha scritto: Hi all. There a port for meta-tensorflow for Krogoth or Sumo? Mayabe I need to use it on this distribution Thaks M Il 21/02/19 12:37, Hongxu Jia ha scritto: Hi RP and Yocto folks, Currently AI on IoT edge becomes more and more popular, but there is no machine learning framework in Yocto/OE. With the support of Eric , Robert and Randy, after two months effort, I've integrated TensorFlow to Yocto. Now, I contribute the patches to Yocto for review, and apply for creating a layer named `meta-tensorflow' on Yocto. For test convenient, there is a fork on github: https://github.com/hongxu-jia/meta-tensorflow BTW, I have contributed other 11 fundamental recipes to meta-openembedded and all of them have been merged to master branch. Please no hesitate to share your suggestion. //Hongxu Testing Commands: - See README Testing, Expected Results: -- See README -- ___ yocto mailing list yocto@yoctoproject.org https://lists.yoctoproject.org/listinfo/yocto
Re: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto
I forked the repository and I'm tryng to port the layer for Krogoth M Il 20/11/19 15:37, Mauro Ziliani ha scritto: Hi all. There a port for meta-tensorflow for Krogoth or Sumo? Mayabe I need to use it on this distribution Thaks M Il 21/02/19 12:37, Hongxu Jia ha scritto: Hi RP and Yocto folks, Currently AI on IoT edge becomes more and more popular, but there is no machine learning framework in Yocto/OE. With the support of Eric , Robert and Randy, after two months effort, I've integrated TensorFlow to Yocto. Now, I contribute the patches to Yocto for review, and apply for creating a layer named `meta-tensorflow' on Yocto. For test convenient, there is a fork on github: https://github.com/hongxu-jia/meta-tensorflow BTW, I have contributed other 11 fundamental recipes to meta-openembedded and all of them have been merged to master branch. Please no hesitate to share your suggestion. //Hongxu Testing Commands: - See README Testing, Expected Results: -- See README -- ___ yocto mailing list yocto@yoctoproject.org https://lists.yoctoproject.org/listinfo/yocto
Re: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto
> -Original Message- > From: Khem Raj > Sent: 23 February 2019 17:05 > To: Richard Purdie > Cc: Manjukumar Harthikote Matha ; Stephen Lawrence > ; Hongxu Jia ; > mhalst...@linuxfoundation.org; ross.bur...@intel.com; > paul.eggle...@linux.intel.com; yocto@yoctoproject.org; lpd-cdc-core- > d...@windriver.com; zhangle.y...@windriver.com > Subject: Re: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto > [snip] > > I believe that meta-oe is too large to be maintainable and that we need > > a larger number of smaller layers. > > > > There is a fine balance to be had, that I have come to realize over years now > but AI is large enough and segmented enough to have a layer of its own. > > > Having tensorflow in its own layer which as a specific purpose and its > > specific maintainers who understand it is in my view much more > > desirable and sustainable. > > I think its a good idea to have various AI infras in one layer > including tensorflow > unless we have large enough dev community to maintain each of them so I like > meta-ai conceptually. From a brief discussion with the team here one issue is the low backwards compatibility between models from different Tensorflow versions. I don't know how fast upstream is moving, but there may be demand to support more than one version per YP version. That's not unsurmountable of course, but I thought I would mention it. meta-renesas-ai has a MIT license btw if it’s a help in creating something more generic and shared. Regards Steve -- ___ yocto mailing list yocto@yoctoproject.org https://lists.yoctoproject.org/listinfo/yocto
Re: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto
Hi Hongxu, > -Original Message- > From: yocto-boun...@yoctoproject.org [mailto:yocto-boun...@yoctoproject.org] > On Behalf Of Stephen Lawrence > Sent: Friday, February 22, 2019 8:52 AM > To: Hongxu Jia ; richard.pur...@linuxfoundation.org; > mhalst...@linuxfoundation.org; ross.bur...@intel.com; raj.k...@gmail.com; > paul.eggle...@linux.intel.com; yocto@yoctoproject.org > Cc: lpd-cdc-core-...@windriver.com; zhangle.y...@windriver.com > Subject: Re: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto > > Hi Hongxu, > > > -Original Message- > > From: yocto-boun...@yoctoproject.org > > On Behalf Of Hongxu Jia > > Sent: 21 February 2019 11:37 > > To: richard.pur...@linuxfoundation.org; mhalst...@linuxfoundation.org; > > ross.bur...@intel.com; raj.k...@gmail.com; > > paul.eggle...@linux.intel.com; yocto@yoctoproject.org > > Cc: lpd-cdc-core-...@windriver.com; zhangle.y...@windriver.com > > Subject: [yocto] Review request 0/13: Contribute meta-tensorflow to > > Yocto > > > > Hi RP and Yocto folks, > > > > Currently AI on IoT edge becomes more and more popular, but there is > > no machine learning framework in Yocto/OE. With the support of Eric > > , Robert and > > Randy , after two months effort, I've > > integrated TensorFlow to Yocto. > > Good work. > > You might be interested in the yocto layers for tensorflow, tensorflow-lite > and > caffe2 on github here [1]. I'm not part of the team that developed that work > but I > forwarded your announcement to them. Perhaps there is the opportunity for some > collaboration on the platform independent parts. The maintainer details are > in the > readme. > Thanks for the layer Hongxu. I agree with Steve, it would be good if you could collaborate with meta-renesas-ai and introduce the layer as meta-ai under meta-openembedded. Thanks, Manju > [1] https://github.com/renesas-rz/meta-renesas-ai > > The layers were developed for the industrial focused Renesas RZ/G1 platforms. > > Regards > > Steve > -- > ___ > yocto mailing list > yocto@yoctoproject.org > https://lists.yoctoproject.org/listinfo/yocto -- ___ yocto mailing list yocto@yoctoproject.org https://lists.yoctoproject.org/listinfo/yocto
Re: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto
On 2019/2/24 上午1:04, Khem Raj wrote: On Sat, Feb 23, 2019 at 7:29 AM Richard Purdie wrote: On Fri, 2019-02-22 at 20:49 +, Manjukumar Harthikote Matha wrote: You might be interested in the yocto layers for tensorflow, tensorflow-lite and caffe2 on github here [1]. I'm not part of the team that developed that work but I forwarded your announcement to them. Perhaps there is the opportunity for some collaboration on the platform independent parts. The maintainer details are in the readme. Thanks for the layer Hongxu. I agree with Steve, it would be good if you could collaborate with meta-renesas-ai and introduce the layer as meta-ai under meta-openembedded. Please don't do the meta-openembedded part! I would agree to not make it a sub layer under meta-openembedded, but it can be hosted on openembedded git infrastructure, I dont see much problem with that if thats the case I believe that meta-oe is too large to be maintainable and that we need a larger number of smaller layers. There is a fine balance to be had, that I have come to realize over years now but AI is large enough and segmented enough to have a layer of its own. Having tensorflow in its own layer which as a specific purpose and its specific maintainers who understand it is in my view much more desirable and sustainable. I think its a good idea to have various AI infras in one layer including tensorflow unless we have large enough dev community to maintain each of them so I like meta-ai conceptually. I know to create a standalone meta-ai than meta-tensorflow is more reasonable, that's my initial layer naming, but - It will dramatically increase the maintainer burden, so I limit the scope to the specific framework name. There are lots of TODO in tensorflow and I am afraid I do not have extra attention to other AI framework recently. - Tensorflow is standalone enough, its build system is google's `bazel', like bitbake, it has special rules to build everything from scratch. (I've already sent other unbazel built recipes to meta-openembedded) - Bazel is built by java, if we do not create sub layer in meta-ai (such as meta-ai/meta-tensorflow), the number of meta-ai layer deps will be more and more along with other AI frameworks are added. For other AI framework customer, depends unused layer is not a good idea. - For future AI framework integration, if the framework is huge like TensorFlow (another well known is Facebook's PyTorch), we could create a standalone layer and appoint special maintainer to maintain it; if the framework is small and light, or fundamental algorithm packages used by multiple frameworks, we could create a meta-ai for collection, or directly add them to meta-openembedded. (For TensorFlow integration, I added 11 fundamental recipes to meta-openembedded ) //Hongxu Cheers, Richard -- ___ yocto mailing list yocto@yoctoproject.org https://lists.yoctoproject.org/listinfo/yocto
Re: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto
On 2019/2/23 下午11:29, Richard Purdie wrote: Please don't do the meta-openembedded part! OK, I can't agree more, for tensorflow, if we move it to meta-openembedded/meta-ai, we have to move the depending layer `meta-java' to meta-openembedded but it has been already as a standalone layer , otherwise the meta-openembedded will depend outer layer. //Hongxu I believe that meta-oe is too large to be maintainable and that we need a larger number of smaller layers. Having tensorflow in its own layer which as a specific purpose and its specific maintainers who understand it is in my view much more desirable and sustainable. Cheers, Richard -- ___ yocto mailing list yocto@yoctoproject.org https://lists.yoctoproject.org/listinfo/yocto
Re: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto
On Sat, Feb 23, 2019 at 7:29 AM Richard Purdie wrote: > > On Fri, 2019-02-22 at 20:49 +, Manjukumar Harthikote Matha wrote: > > > > > > You might be interested in the yocto layers for tensorflow, > > > tensorflow-lite and > > > caffe2 on github here [1]. I'm not part of the team that developed > > > that work but I > > > forwarded your announcement to them. Perhaps there is the > > > opportunity for some > > > collaboration on the platform independent parts. The maintainer > > > details are in the > > > readme. > > > > > > > Thanks for the layer Hongxu. I agree with Steve, it would be good if > > you could collaborate with meta-renesas-ai and introduce the layer as > > meta-ai under meta-openembedded. > > Please don't do the meta-openembedded part! > I would agree to not make it a sub layer under meta-openembedded, but it can be hosted on openembedded git infrastructure, I dont see much problem with that if thats the case > I believe that meta-oe is too large to be maintainable and that we need > a larger number of smaller layers. > There is a fine balance to be had, that I have come to realize over years now but AI is large enough and segmented enough to have a layer of its own. > Having tensorflow in its own layer which as a specific purpose and its > specific maintainers who understand it is in my view much more > desirable and sustainable. I think its a good idea to have various AI infras in one layer including tensorflow unless we have large enough dev community to maintain each of them so I like meta-ai conceptually. > > Cheers, > > Richard > -- ___ yocto mailing list yocto@yoctoproject.org https://lists.yoctoproject.org/listinfo/yocto
Re: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto
On Fri, 2019-02-22 at 20:49 +, Manjukumar Harthikote Matha wrote: > > > > You might be interested in the yocto layers for tensorflow, > > tensorflow-lite and > > caffe2 on github here [1]. I'm not part of the team that developed > > that work but I > > forwarded your announcement to them. Perhaps there is the > > opportunity for some > > collaboration on the platform independent parts. The maintainer > > details are in the > > readme. > > > > Thanks for the layer Hongxu. I agree with Steve, it would be good if > you could collaborate with meta-renesas-ai and introduce the layer as > meta-ai under meta-openembedded. Please don't do the meta-openembedded part! I believe that meta-oe is too large to be maintainable and that we need a larger number of smaller layers. Having tensorflow in its own layer which as a specific purpose and its specific maintainers who understand it is in my view much more desirable and sustainable. Cheers, Richard -- ___ yocto mailing list yocto@yoctoproject.org https://lists.yoctoproject.org/listinfo/yocto
Re: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto
On 2019/2/23 上午4:49, Manjukumar Harthikote Matha wrote: Hi Hongxu, -Original Message- From: yocto-boun...@yoctoproject.org [mailto:yocto-boun...@yoctoproject.org] On Behalf Of Stephen Lawrence Sent: Friday, February 22, 2019 8:52 AM To: Hongxu Jia ; richard.pur...@linuxfoundation.org; mhalst...@linuxfoundation.org; ross.bur...@intel.com; raj.k...@gmail.com; paul.eggle...@linux.intel.com; yocto@yoctoproject.org Cc: lpd-cdc-core-...@windriver.com; zhangle.y...@windriver.com Subject: Re: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto Hi Hongxu, -Original Message- From: yocto-boun...@yoctoproject.org On Behalf Of Hongxu Jia Sent: 21 February 2019 11:37 To: richard.pur...@linuxfoundation.org; mhalst...@linuxfoundation.org; ross.bur...@intel.com; raj.k...@gmail.com; paul.eggle...@linux.intel.com; yocto@yoctoproject.org Cc: lpd-cdc-core-...@windriver.com; zhangle.y...@windriver.com Subject: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto Hi RP and Yocto folks, Currently AI on IoT edge becomes more and more popular, but there is no machine learning framework in Yocto/OE. With the support of Eric , Robert and Randy , after two months effort, I've integrated TensorFlow to Yocto. Good work. You might be interested in the yocto layers for tensorflow, tensorflow-lite and caffe2 on github here [1]. I'm not part of the team that developed that work but I forwarded your announcement to them. Perhaps there is the opportunity for some collaboration on the platform independent parts. The maintainer details are in the readme. Thanks for the layer Hongxu. I agree with Steve, it would be good if you could collaborate with meta-renesas-ai and introduce the layer as meta-ai under meta-openembedded. Agree, I will add it to my TODO list, more AI, more machine learning framework should be integrated to Yocto. //Hongxu Thanks, Manju [1] https://github.com/renesas-rz/meta-renesas-ai The layers were developed for the industrial focused Renesas RZ/G1 platforms. Regards Steve -- ___ yocto mailing list yocto@yoctoproject.org https://lists.yoctoproject.org/listinfo/yocto -- ___ yocto mailing list yocto@yoctoproject.org https://lists.yoctoproject.org/listinfo/yocto
Re: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto
Hi Hongxu, > -Original Message- > From: yocto-boun...@yoctoproject.org On > Behalf > Of Hongxu Jia > Sent: 21 February 2019 11:37 > To: richard.pur...@linuxfoundation.org; mhalst...@linuxfoundation.org; > ross.bur...@intel.com; raj.k...@gmail.com; paul.eggle...@linux.intel.com; > yocto@yoctoproject.org > Cc: lpd-cdc-core-...@windriver.com; zhangle.y...@windriver.com > Subject: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto > > Hi RP and Yocto folks, > > Currently AI on IoT edge becomes more and more popular, but there is no > machine learning framework in Yocto/OE. With the support of Eric > , Robert > and Randy , after two months effort, I've > integrated TensorFlow to Yocto. Good work. You might be interested in the yocto layers for tensorflow, tensorflow-lite and caffe2 on github here [1]. I'm not part of the team that developed that work but I forwarded your announcement to them. Perhaps there is the opportunity for some collaboration on the platform independent parts. The maintainer details are in the readme. [1] https://github.com/renesas-rz/meta-renesas-ai The layers were developed for the industrial focused Renesas RZ/G1 platforms. Regards Steve -- ___ yocto mailing list yocto@yoctoproject.org https://lists.yoctoproject.org/listinfo/yocto
Re: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto
On Fri, Feb 22, 2019 at 8:51 AM Stephen Lawrence wrote: > > Hi Hongxu, > > > -Original Message- > > From: yocto-boun...@yoctoproject.org On > > Behalf > > Of Hongxu Jia > > Sent: 21 February 2019 11:37 > > To: richard.pur...@linuxfoundation.org; mhalst...@linuxfoundation.org; > > ross.bur...@intel.com; raj.k...@gmail.com; paul.eggle...@linux.intel.com; > > yocto@yoctoproject.org > > Cc: lpd-cdc-core-...@windriver.com; zhangle.y...@windriver.com > > Subject: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto > > > > Hi RP and Yocto folks, > > > > Currently AI on IoT edge becomes more and more popular, but there is no > > machine learning framework in Yocto/OE. With the support of Eric > > , Robert > > and Randy , after two months effort, I've > > integrated TensorFlow to Yocto. > > Good work. > > You might be interested in the yocto layers for tensorflow, tensorflow-lite > and caffe2 > on github here [1]. I'm not part of the team that developed that work but I > forwarded > your announcement to them. Perhaps there is the opportunity for some > collaboration > on the platform independent parts. The maintainer details are in the readme. > > [1] https://github.com/renesas-rz/meta-renesas-ai > > The layers were developed for the industrial focused Renesas RZ/G1 platforms. > It would be great to cherry-pick goodies from these layers and maintain a single layer which can be sustained and support wide variety of platforms and distributions. > Regards > > Steve -- ___ yocto mailing list yocto@yoctoproject.org https://lists.yoctoproject.org/listinfo/yocto
Re: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto
On 2019/2/23 上午12:51, Stephen Lawrence wrote: Good work. You might be interested in the yocto layers for tensorflow, tensorflow-lite and caffe2 on github here [1]. I'm not part of the team that developed that work but I forwarded your announcement to them. Perhaps there is the opportunity for some collaboration on the platform independent parts. The maintainer details are in the readme. Yes, I know meta-renesas-ai, my first try of tensorflow build was based on it, but failed, I am afraid its version is old and no maintenance. So I choose to refer upstream arm compiler which `Build from source for the Raspberry Pi' https://www.tensorflow.org/install/source_rpi For tensorflow-lite, I am afraid it is not completed in meta-renesas-ai. But tensorflow-lite is on my TODO list, Currently I am not sure what to build (may be c/c++ framework) and how to use (use cases). For caffe2, it is another story `pytorch', I am afraid I don't have resources(time) to focus //Hongxu [1]https://github.com/renesas-rz/meta-renesas-ai The layers were developed for the industrial focused Renesas RZ/G1 platforms. Regards -- ___ yocto mailing list yocto@yoctoproject.org https://lists.yoctoproject.org/listinfo/yocto
Re: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto
On Thu, Feb 21, 2019 at 4:27 AM Richard Purdie < richard.pur...@linuxfoundation.org> wrote: > Hi Hongxu, > > On Thu, 2019-02-21 at 06:37 -0500, Hongxu Jia wrote: > > Currently AI on IoT edge becomes more and more popular, but there is > > no > > machine learning framework in Yocto/OE. With the support of Eric > > , Robert > > and Randy , after two months effort, > > I've > > integrated TensorFlow to Yocto. > > > > Now, I contribute the patches to Yocto for review, and apply for > > creating > > a layer named `meta-tensorflow' on Yocto. > > > > For test convenient, there is a fork on github: > > https://github.com/hongxu-jia/meta-tensorflow > > > > BTW, I have contributed other 11 fundamental recipes to meta- > > openembedded > > and all of them have been merged to master branch. > > > > Please no hesitate to share your suggestion. > > I like this a lot, thanks for working on and sharing it! > > I had a quick glance through the patches and I didn't see anything that > concerned me. I don't have much knowledge about tensor flow. I think > this would make a great addition to git.yoctoproject.org and would love > to see it there. > > Thanks again, I'm pleased to see something like this! > This is great. I had started writing a bazel recipe around the time of the last ELC/YP DevDay, but got blocked. I’ll take a look and give it a spin. Thank you for working on this. —Tim > > Cheers, > > Richard > > -- > ___ > yocto mailing list > yocto@yoctoproject.org > https://lists.yoctoproject.org/listinfo/yocto > -- ___ yocto mailing list yocto@yoctoproject.org https://lists.yoctoproject.org/listinfo/yocto
Re: [yocto] Review request 0/13: Contribute meta-tensorflow to Yocto
Hi Hongxu, On Thu, 2019-02-21 at 06:37 -0500, Hongxu Jia wrote: > Currently AI on IoT edge becomes more and more popular, but there is > no > machine learning framework in Yocto/OE. With the support of Eric > , Robert > and Randy , after two months effort, > I've > integrated TensorFlow to Yocto. > > Now, I contribute the patches to Yocto for review, and apply for > creating > a layer named `meta-tensorflow' on Yocto. > > For test convenient, there is a fork on github: > https://github.com/hongxu-jia/meta-tensorflow > > BTW, I have contributed other 11 fundamental recipes to meta- > openembedded > and all of them have been merged to master branch. > > Please no hesitate to share your suggestion. I like this a lot, thanks for working on and sharing it! I had a quick glance through the patches and I didn't see anything that concerned me. I don't have much knowledge about tensor flow. I think this would make a great addition to git.yoctoproject.org and would love to see it there. Thanks again, I'm pleased to see something like this! Cheers, Richard -- ___ yocto mailing list yocto@yoctoproject.org https://lists.yoctoproject.org/listinfo/yocto
