Re: [COVID-19 Hackathon] Bazel build system pending NEW
Hi, > eigen: sometimes TF relies on new features that debian's libeigen3-dev >does not provide. In that case we have to use an embedded >tarball again. The new 3.3.8 release seems to be scheduled on 7th of september [1]. If it has features that you need, please just wait a couple of days and it will be uploaded into the archive. [1] https://listengine.tuxfamily.org/lists.tuxfamily.org/eigen/2020/08/msg1.html Best regards Anton Am Di., 1. Sept. 2020 um 04:37 Uhr schrieb Mo Zhou : > Hi Michael, > > I went through the list of missing dependencies. > > aws-*: I'm not interested in them. In the past I just (manually) > filtered out all the code associated with aws functionalities. > Most of them are possibly not packaged yet. > > abseil-cpp: this is a tricky one. Similar to facebook/folly. It does > not guarantee a stable ABI. Once the system-provided abseil > breaks the tensorflow, we have to embed one. > > Anyway it's present in our archive: libabsl-dev but I don't > know whether tensorflow builds against it. > > re2: already present in archive. I guess there is no reason to embed it. > > boringssl: maybe a simple string replacement s/boring/open/g will just > work? > > farmhash: in archive, and I'm the uploader. Ping me if it needs to be > updated. > > eigen: sometimes TF relies on new features that debian's libeigen3-dev > does not provide. In that case we have to use an embedded > tarball again. > > highwayhash: in archive, and I'm the uploader. > > fft2d: TF uses merely 1 source file from this project for merely > one OP/Kernel. Just keep it embedded. > The last upstream update was ~10 yrs ago (IIRC). > > On Mon, Aug 31, 2020 at 05:32:56PM +0200, Michael R. Crusoe wrote: > > Hey Mo, we have some unpackaged dependencies. Currently TensorFlow can > be built > > using code copies, but obviously that isn't a great plan. Here are the > current > > code copies: > https://github.com/meteorcloudy/tensorflow/tree/r2.2-debian/debian > > /dist > > > > If you want to help out you can use the bazel-bootstrap and > > libcheck-framework-java binary packages from > https://people.debian.org/~olek/ > > packages/ > > Great! Thanks for the hint. > >
Re: [COVID-19 Hackathon] Bazel build system pending NEW
Hi Michael, I went through the list of missing dependencies. aws-*: I'm not interested in them. In the past I just (manually) filtered out all the code associated with aws functionalities. Most of them are possibly not packaged yet. abseil-cpp: this is a tricky one. Similar to facebook/folly. It does not guarantee a stable ABI. Once the system-provided abseil breaks the tensorflow, we have to embed one. Anyway it's present in our archive: libabsl-dev but I don't know whether tensorflow builds against it. re2: already present in archive. I guess there is no reason to embed it. boringssl: maybe a simple string replacement s/boring/open/g will just work? farmhash: in archive, and I'm the uploader. Ping me if it needs to be updated. eigen: sometimes TF relies on new features that debian's libeigen3-dev does not provide. In that case we have to use an embedded tarball again. highwayhash: in archive, and I'm the uploader. fft2d: TF uses merely 1 source file from this project for merely one OP/Kernel. Just keep it embedded. The last upstream update was ~10 yrs ago (IIRC). On Mon, Aug 31, 2020 at 05:32:56PM +0200, Michael R. Crusoe wrote: > Hey Mo, we have some unpackaged dependencies. Currently TensorFlow can be > built > using code copies, but obviously that isn't a great plan. Here are the current > code copies: > https://github.com/meteorcloudy/tensorflow/tree/r2.2-debian/debian > /dist > > If you want to help out you can use the bazel-bootstrap and > libcheck-framework-java binary packages from https://people.debian.org/~olek/ > packages/ Great! Thanks for the hint.
Re: [COVID-19 Hackathon] Bazel build system pending NEW
On Mon, Aug 24, 2020 at 4:51 PM Olek Wojnar wrote: > Hi Mo, > > Sorry about the slow reply, I've been a bit buried with emails and I'm not > answering them as well as I would like. :( > > On Wed, Aug 19, 2020 at 12:40 AM Mo Zhou wrote: > >> Hi Olek, >> >> What a good news! Your hardword is much appreciated. >> > > Thanks! I'm really looking forward to this making life easier for people > who want to package software that uses Bazel to build. > > There are some preliminary packaging changes (using bazel) for >> tensorflow. Is it in shape so that I can build TF from the git repo? >> Or what remains to be done? >> > > I'm not sure, Michael (copied above) took the lead on the TensorFlow > packaging. Michael, could you please provide an update? Are you running > into any specific issues that you could use help with? > Hey Mo, we have some unpackaged dependencies. Currently TensorFlow can be built using code copies, but obviously that isn't a great plan. Here are the current code copies: https://github.com/meteorcloudy/tensorflow/tree/r2.2-debian/debian/dist If you want to help out you can use the bazel-bootstrap and libcheck-framework-java binary packages from https://people.debian.org/~olek/packages/ > > Our primary contact on the upstream Bazel team (who also does some work > with upstream TensorFlow) verified that the latest Debian Bazel > (bazel-bootstrap) package *does* successfully build TensorFlow but I > believe there may have been some TensorFlow dependencies that were still > missing in Debian? > I've added our upstream contact Yun Peng to this thread. > > -Olek >
Re: [COVID-19 Hackathon] Bazel build system pending NEW
Hi Mo, Sorry about the slow reply, I've been a bit buried with emails and I'm not answering them as well as I would like. :( On Wed, Aug 19, 2020 at 12:40 AM Mo Zhou wrote: > Hi Olek, > > What a good news! Your hardword is much appreciated. > Thanks! I'm really looking forward to this making life easier for people who want to package software that uses Bazel to build. There are some preliminary packaging changes (using bazel) for > tensorflow. Is it in shape so that I can build TF from the git repo? > Or what remains to be done? > I'm not sure, Michael (copied above) took the lead on the TensorFlow packaging. Michael, could you please provide an update? Are you running into any specific issues that you could use help with? Our primary contact on the upstream Bazel team (who also does some work with upstream TensorFlow) verified that the latest Debian Bazel (bazel-bootstrap) package *does* successfully build TensorFlow but I believe there may have been some TensorFlow dependencies that were still missing in Debian? -Olek
Re: [COVID-19 Hackathon] Bazel build system pending NEW
Hi Olek, What a good news! Your hardword is much appreciated. There are some preliminary packaging changes (using bazel) for tensorflow. Is it in shape so that I can build TF from the git repo? Or what remains to be done? On Tue, Aug 18, 2020 at 05:03:23PM -0400, Olek Wojnar wrote: > Dear FTP Team, > > The Debian Med Team is currently in its third hackathon [1] to enable > better tools for doctors and scientists to fight COVID-19. Our > longest-running effort, which we started at the beginning of the first > COVID-19 hackathon, is now almost at an end! I uploaded the bootstrap > variant of the Bazel build system to NEW a couple days ago [2]. This has > only one build-dependency that is not in Debian yet. [3] Once both > packages clear NEW, TensorFlow and other pieces of software that use the > Bazel build system will be available to Debian users. More specifically, > this software will be available to the above-mentioned doctors and > scientists. > > I'd like to also take this opportunity to publicly acknowledge the > amazing support that we received from the Google Bazel team. Without > their tireless efforts to help us enable the Bazel build system to be > Debian-friendly, we could not have accomplished this. Their support for > Debian and global health has been extremely motivating for those of us > working (in our own ways) to fight this global crisis. > > With all of that being said, this will be the last time during this > endeavor that I will be asking for special consideration. I greatly > appreciate all the expedited NEW processing of the 14 Bazel build > dependencies that you previously approved. If possible, I would greatly > appreciate it if one of you was able to take a quick look at these > remaining two packages. I'm available to address any issues or questions > you may have. > > Thank you very much in advance!! > > -Olek > > > [1] https://lists.debian.org/debian-devel/2020/08/msg00094.html > [2] https://ftp-master.debian.org/new/bazel-bootstrap_3.4.0%2Bds-1.html > [3] > https://ftp-master.debian.org/new/checker-framework-java_3.0.1%2Bds-1~exp2.html > >
[COVID-19 Hackathon] Bazel build system pending NEW
Dear FTP Team, The Debian Med Team is currently in its third hackathon [1] to enable better tools for doctors and scientists to fight COVID-19. Our longest-running effort, which we started at the beginning of the first COVID-19 hackathon, is now almost at an end! I uploaded the bootstrap variant of the Bazel build system to NEW a couple days ago [2]. This has only one build-dependency that is not in Debian yet. [3] Once both packages clear NEW, TensorFlow and other pieces of software that use the Bazel build system will be available to Debian users. More specifically, this software will be available to the above-mentioned doctors and scientists. I'd like to also take this opportunity to publicly acknowledge the amazing support that we received from the Google Bazel team. Without their tireless efforts to help us enable the Bazel build system to be Debian-friendly, we could not have accomplished this. Their support for Debian and global health has been extremely motivating for those of us working (in our own ways) to fight this global crisis. With all of that being said, this will be the last time during this endeavor that I will be asking for special consideration. I greatly appreciate all the expedited NEW processing of the 14 Bazel build dependencies that you previously approved. If possible, I would greatly appreciate it if one of you was able to take a quick look at these remaining two packages. I'm available to address any issues or questions you may have. Thank you very much in advance!! -Olek [1] https://lists.debian.org/debian-devel/2020/08/msg00094.html [2] https://ftp-master.debian.org/new/bazel-bootstrap_3.4.0%2Bds-1.html [3] https://ftp-master.debian.org/new/checker-framework-java_3.0.1%2Bds-1~exp2.html signature.asc Description: OpenPGP digital signature
