Re: [ceph-users] Should ceph build against libcurl4 for Ubuntu 18.04 and later?
Figured I would chime in as also having this issue. Moving from 16.04 to 18.04 on some OSD nodes. I have been using the ceph apt repo > deb https://download.ceph.com/debian-luminous/ xenial main During the release-upgrade, it can’t find a candidate package, and actually removes the ceph-osd package. This is what dpkg showed after the reboot: > $ dpkg -l | grep ceph > rc ceph-base 12.2.10-1xenial > amd64common ceph daemon libraries and management tools > rc ceph-common 12.2.10-1xenial > amd64common utilities to mount and interact with a ceph > storage cluster > ii ceph-deploy 2.0.1 > all Ceph-deploy is an easy to use configuration tool > ii ceph-fuse 12.2.10-1xenial > amd64FUSE-based client for the Ceph distributed file system > rc ceph-mds 12.2.10-1xenial > amd64metadata server for the ceph distributed file system > rc ceph-mgr 12.2.10-1xenial > amd64manager for the ceph distributed storage system > rc ceph-mon 12.2.10-1xenial > amd64monitor server for the ceph storage system > rc ceph-osd 12.2.10-1xenial > amd64OSD server for the ceph storage system > ii libcephfs212.2.10-1xenial > amd64Ceph distributed file system client library > ii python-cephfs 12.2.10-1xenial > amd64Python 2 libraries for the Ceph libcephfs library After the reboot to complete the upgrade, I tried to install the ceph-osd package back, using the bionic repo, and get complaints about ceph-common and ceph-base, which was an endless rabbit hole of dependencies that lead to libcurl3. My solution in the end to get things back up and running was to remove the ceph repo and move to the Ubuntu repo, and manually specify the package in apt for every package in the chain. > $ sudo apt install ceph-common=12.2.7-0ubuntu0.18.04.1 > ceph-base=12.2.7-0ubuntu0.18.04.1 ceph-fuse=12.2.7-0ubuntu0.18.04.1 > ceph-osd=12.2.7-0ubuntu0.18.04.1 libcephfs2=12.2.7-0ubuntu0.18.04.1 > python-cephfs=12.2.7-0ubuntu0.18.04.1 python-rados=12.2.7-0ubuntu0.18.04.1 > librbd1=12.2.7-0ubuntu0.18.04.1 python-rbd=12.2.7-0ubuntu0.18.04.1 > librados2=12.2.7-0ubuntu0.18.04.1 librados-dev=12.2.7-0ubuntu0.18.04.1 > libradosstriper1=12.2.7-0ubuntu0.18.04.1 Obviously not ideal, but I assume that it will hold me over until the luminous-bionic repos are able to handle libcurl4 dependencies, or my Mimic window rolls around. Just wanted to chime in that I ran into this issue, and how I worked around it. Reed > On Nov 26, 2018, at 11:11 AM, Ken Dreyer wrote: > > On Thu, Nov 22, 2018 at 11:47 AM Matthew Vernon wrote: >> >> On 22/11/2018 13:40, Paul Emmerich wrote: >>> We've encountered the same problem on Debian Buster >> >> It looks to me like this could be fixed simply by building the Bionic >> packages in a Bionic chroot (ditto Buster); maybe that could be done in >> future? Given I think the packaging process is being reviewed anyway at >> the moment (hopefully 12.2.10 will be along at some point...) > > That's how we're building it currently. We build ceph in pbuilder > chroots that correspond to each distro. > > On master, debian/control has Build-Depends: libcurl4-openssl-dev so > I'm not sure why we'd end up with a dependency on libcurl3. > > Would you please give me a minimal set of `apt-get` reproduction steps > on Bionic for this issue? Then we can get it into tracker.ceph.com. > > - Ken > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com smime.p7s Description: S/MIME cryptographic signature ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Should ceph build against libcurl4 for Ubuntu 18.04 and later?
Hi, Sorry for the slow reply. On 26/11/2018 17:11, Ken Dreyer wrote: On Thu, Nov 22, 2018 at 11:47 AM Matthew Vernon wrote: On 22/11/2018 13:40, Paul Emmerich wrote: We've encountered the same problem on Debian Buster It looks to me like this could be fixed simply by building the Bionic packages in a Bionic chroot (ditto Buster); maybe that could be done in future? Given I think the packaging process is being reviewed anyway at the moment (hopefully 12.2.10 will be along at some point...) That's how we're building it currently. We build ceph in pbuilder chroots that correspond to each distro. On master, debian/control has Build-Depends: libcurl4-openssl-dev so I'm not sure why we'd end up with a dependency on libcurl3. Would you please give me a minimal set of `apt-get` reproduction steps on Bionic for this issue? Then we can get it into tracker.ceph.com. The problem is a bit different to what I thought: there is only 1 package in the bionic Release file on ceph.com, and that's ceph-deploy: matthew@aragorn:/tmp$ curl -s 'http://download.ceph.com/debian-luminous/dists/bionic/main/binary-amd64/Packages' -o bionicPackages matthew@aragorn:/tmp$ grep Package bionicPackages Package: ceph-deploy matthew@aragorn:/tmp$ curl -s 'http://download.ceph.com/debian-luminous/dists/xenial/main/binary-amd64/Packages' -o xenialPackages matthew@aragorn:/tmp$ grep -c Package xenialPackages 63 (i.e. there are 63 packages in the Xenial distribution of luminous, and only 1 in the Bionic one). So if you have a Xenial system running luminous and upgrade it to Bionic, then you'll keep the Xenial/luminous packages (since they're more recent than the Ubuntu-supplied Bionic packages), and encounter the problem that they depend on libcurl3, which is incompatible with Bionic's curl: root@sto-j1-2:~# dpkg -s radosgw | sed -ne '/Depends/s/.*, \(libcurl[^,]*\),.*/\1/p' libcurl3 (>= 7.28.0) So the problem is really that the Bionic-built packages are not making into the release (presumably because they don't make it to the mirror?) Regards, Matthew -- The Wellcome Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Should ceph build against libcurl4 for Ubuntu 18.04 and later?
On Thu, Nov 22, 2018 at 11:47 AM Matthew Vernon wrote: > > On 22/11/2018 13:40, Paul Emmerich wrote: > > We've encountered the same problem on Debian Buster > > It looks to me like this could be fixed simply by building the Bionic > packages in a Bionic chroot (ditto Buster); maybe that could be done in > future? Given I think the packaging process is being reviewed anyway at > the moment (hopefully 12.2.10 will be along at some point...) That's how we're building it currently. We build ceph in pbuilder chroots that correspond to each distro. On master, debian/control has Build-Depends: libcurl4-openssl-dev so I'm not sure why we'd end up with a dependency on libcurl3. Would you please give me a minimal set of `apt-get` reproduction steps on Bionic for this issue? Then we can get it into tracker.ceph.com. - Ken ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Should ceph build against libcurl4 for Ubuntu 18.04 and later?
On 22/11/2018 13:40, Paul Emmerich wrote: We've encountered the same problem on Debian Buster It looks to me like this could be fixed simply by building the Bionic packages in a Bionic chroot (ditto Buster); maybe that could be done in future? Given I think the packaging process is being reviewed anyway at the moment (hopefully 12.2.10 will be along at some point...) Regards, Matthew -- The Wellcome Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Should ceph build against libcurl4 for Ubuntu 18.04 and later?
We've encountered the same problem on Debian Buster Paul -- Paul Emmerich Looking for help with your Ceph cluster? Contact us at https://croit.io croit GmbH Freseniusstr. 31h 81247 München www.croit.io Tel: +49 89 1896585 90 Am Do., 22. Nov. 2018 um 13:58 Uhr schrieb Richard Hesketh : > > Bionic's mimic packages do seem to depend on libcurl4 already, for what > that's worth: > > root@vm-gw-1:/# apt-cache depends ceph-common > ceph-common > ... > Depends: libcurl4 > > > On 22/11/2018 12:40, Matthew Vernon wrote: > > Hi, > > > > The ceph.com ceph luminous packages for Ubuntu Bionic still depend on > > libcurl3 (specifically ceph-common, radosgw. librgw2 all depend on > > libcurl3 (>= 7.28.0)). > > > > This means that anything that depends on libcurl4 (which is the default > > libcurl in bionic) isn't co-installable with ceph. That includes the > > "curl" binary itself, which we've been using in a number of our scripts > > / tests / etc. I would expect this to make ceph-test uninstallable on > > Bionic also... > > > > ...so shouldn't ceph packages for Bionic and later releases be compiled > > against libcurl4 (and thus Depend upon it)? The same will apply to the > > next Debian release, I expect. > > > > The curl authors claim the API doesn't have any incompatible changes. > > > > Regards, > > > > Matthew > > [the two packages libcurl3 and libcurl4 are not co-installable because > > libcurl3 includes a libcurl.so.4 for historical reasons :-( ] > > > > > > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Should ceph build against libcurl4 for Ubuntu 18.04 and later?
Bionic's mimic packages do seem to depend on libcurl4 already, for what that's worth: root@vm-gw-1:/# apt-cache depends ceph-common ceph-common ... Depends: libcurl4 On 22/11/2018 12:40, Matthew Vernon wrote: > Hi, > > The ceph.com ceph luminous packages for Ubuntu Bionic still depend on > libcurl3 (specifically ceph-common, radosgw. librgw2 all depend on > libcurl3 (>= 7.28.0)). > > This means that anything that depends on libcurl4 (which is the default > libcurl in bionic) isn't co-installable with ceph. That includes the > "curl" binary itself, which we've been using in a number of our scripts > / tests / etc. I would expect this to make ceph-test uninstallable on > Bionic also... > > ...so shouldn't ceph packages for Bionic and later releases be compiled > against libcurl4 (and thus Depend upon it)? The same will apply to the > next Debian release, I expect. > > The curl authors claim the API doesn't have any incompatible changes. > > Regards, > > Matthew > [the two packages libcurl3 and libcurl4 are not co-installable because > libcurl3 includes a libcurl.so.4 for historical reasons :-( ] > > signature.asc Description: OpenPGP digital signature ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Should ceph build against libcurl4 for Ubuntu 18.04 and later?
Hi, The ceph.com ceph luminous packages for Ubuntu Bionic still depend on libcurl3 (specifically ceph-common, radosgw. librgw2 all depend on libcurl3 (>= 7.28.0)). This means that anything that depends on libcurl4 (which is the default libcurl in bionic) isn't co-installable with ceph. That includes the "curl" binary itself, which we've been using in a number of our scripts / tests / etc. I would expect this to make ceph-test uninstallable on Bionic also... ...so shouldn't ceph packages for Bionic and later releases be compiled against libcurl4 (and thus Depend upon it)? The same will apply to the next Debian release, I expect. The curl authors claim the API doesn't have any incompatible changes. Regards, Matthew [the two packages libcurl3 and libcurl4 are not co-installable because libcurl3 includes a libcurl.so.4 for historical reasons :-( ] -- The Wellcome Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
