Re: asking for advice: all dependencies incl. version numbers

2013-09-05 Thread Stefano Zacchiroli
On Tue, Aug 27, 2013 at 10:17:47AM +0200, FARKAS, Illes wrote:
 Thanks. I found that Managing the Complexity of Large Free and Open Source
 Package-Based
 Software Distributions (PDF at http://goo.gl/NTPqlE) describes the project
 best. By the way, which is your favorite paper from IRILL?

Dear Illes,
  that paper is indeed the starting point of several research works in
the field of formal analysis of relationships between software
components, and in particular FOSS distribution packages.

If you're interested in that field, you might want to have a look at a
recent survey paper (disclaimer: I'm one of the author, an) entitled
Formal Aspects of Free and Open Source Software Components which is
freely available at:

  http://upsilon.cc/~zack/research/publications/fmco2012-foss-components.pdf

( BiBTeX: 
http://upsilon.cc/~zack/research/publications/fmco2012-foss-components.bib )

In there, we made an effort to review research work in the field,
encompassing not only the work done in the context of EDOS / Mancoosi /
IRILL, but also those by other researchers around the world, to the best
of our knowledge. If you're starting in the field, that might be
valuable to you.

As we're quickly getting off-topic for debian-devel, feel free to
contact me (and likely the others who have participated in this thread,
even though I cannot speak for them) off-list.

All the best for your studies,
Cheers.
-- 
Stefano Zacchiroli  . . . . . . .  z...@upsilon.cc . . . . o . . . o . o
Maître de conférences . . . . . http://upsilon.cc/zack . . . o . . . o o
Former Debian Project Leader  . . @zack on identi.ca . . o o o . . . o .
« the first rule of tautology club is the first rule of tautology club »


signature.asc
Description: Digital signature


Re: asking for advice: all dependencies incl. version numbers

2013-08-27 Thread FARKAS, Illes
2013/8/23 Joachim Breitner nome...@debian.org

 Dear Illes,

 Am Donnerstag, den 22.08.2013, 17:47 +0200 schrieb FARKAS, Illes:

  This is a researcher asking for advice.
 
  I'd like to download/parse for each version of each debian package
  which other package versions it depends on.
 
  Do you think this information available in managable formats?

 It is all in the Packages file, e.g.

 ftp://ftp.de.debian.org/debian/dists/unstable/main/binary-amd64/Packages.bz2

 It is a simple text file format and there are parsing libraries for
 various programming language around. If you are more specific about your
 goals and needs, I can give more specific advise.


Dear Joachim, Thanks for your detailed replies.

If I'm not mistaken, then the file you mention lists the dependencies of
the *current* package versions. For example, it tells that version
0.0.13-2+b1 of the package called 0ad depends on the following versions
of the following packages: 0ad-data (= 0.0.13), 0ad-data (= 0.0.13-2),
0ad-data-common (= 0.0.13), etc.

According to the developer info page of the package (
http://packages.qa.debian.org/0/0ad.html) there have been also previous
versions of the package 0ad, for example, versions 0.0.12 and 0.0.11.
I would be curious to know too the list of package versions that
0ad-0.0.12, 0ad-0.0.11, etc depend on. Since I'm trying to find a
standardized way of doing this for all packages/versions, I stayed at the
above URL and I looked into the buildd logs and RDF metadata (links in
the right navigation area). But it seems these are not the files [droids] I
am looking for :-)

So the best solution I can think of right now is to download all
Packages.bz2 files I can find at debian. These may not contain all versions
of all packages, but they will probably contain most of the important
versions of most packages. If you have any other suggestions, I'd be happy
to learn from those.

 Have you seen similar work before?

 The researches at IRILL have done lots of work on Package relationsships
 and also created useful tools to investigate that. I don’t have a good
 entry page to send you to, but I guess http://www.mancoosi.org/edos/ and
 http://www.mancoosi.org/ are of relevance.


Thanks. I found that Managing the Complexity of Large Free and Open Source
Package-Based
Software Distributions (PDF at http://goo.gl/NTPqlE) describes the project
best. By the way, which is your favorite paper from IRILL?

Greetings,
 Joachim
 --
 Joachim nomeata Breitner
 Debian Developer
   nome...@debian.org | ICQ# 74513189 | GPG-Keyid: 4743206C
   JID: nome...@joachim-breitner.de | http://people.debian.org/~nomeata


2013/8/23 Johannes Schauer j.scha...@email.de

 Hi,

 Quoting FARKAS, Illes (2013-08-22 17:47:57)
  I'd like to download/parse for each version of each debian package which
  other package versions it depends on.
 
  Do you think this information available in managable formats?

 In addition to the information Joachim already gave, let me specifically
 point
 you at dose3. It is a framework for working with dependencies and allows
 you to
 parse Packages.bz2 and Sources.bz2 files, create all kinds of dependency
 graphs
 and analyze them and includes a solver for package relationships.


Hi, Johannes (josch). Thanks for your help. The more complex features seem
to be the ones I'm interested in.


  Have you seen similar work before?

 Joachim was pointing you at edos. There exists the tool edos-debcheck (or
 edos-distcheck as a more general tool) in the main archive. But instead you
 might want to look at the dose3 tools which supersede the edos tools. More
 specifically you want to look at the binary packages built from the source
 package dose3. The dose-extra binary package contains a tool called ceve
 which
 allows you to build many different kinds of dependency graphs from a
 Packages.bz2 file. Maybe this gives you the information you need.


 Contact me if you have any trouble.


Thanks, I'll do.

Cheers,
Illes



 cheers, josch




-- 
http://hal.elte.hu/fij


Re: asking for advice: all dependencies incl. version numbers

2013-08-27 Thread Johannes Schauer
Hi,

Quoting FARKAS, Illes (2013-08-27 10:17:47)
 According to the developer info page of the package (http://
 packages.qa.debian.org/0/0ad.html) there have been also previous versions of
 the package 0ad, for example, versions 0.0.12 and 0.0.11. I would be
 curious to know too the list of package versions that 0ad-0.0.12, 0ad-0.0.11,
 etc depend on.

You can find Packages.bz2 files from Debian all the way back to 2005 at
http://snapshot.debian.org by downloading a sample of these (say, every few
days), you can possibly get enough data for older versions of every package
maintained in Debian since then.

Unfortunately, older versions of Packages.b2 files on snapshot.d.o contain
errors which make it impossible for dose3 to parse them. Since later in your
email you said you might want to use dose3, you might want to have a look at
this script I wrote to clean up and repair old Packages.bz2 files from
snapshot.d.o so that dose3 can parse them:

https://gitorious.org/debian-bootstrap/botch/source/examples/snapshot/download.sh

That script downloads and cleans Packages.bz2 and Sources.bz2 from
snapshot.d.org in a five day interval starting in 2005. You can find a bit more
here:

http://blog.mister-muffin.de/2012/10/12/analyzing-packages-and-sources-from-snapshot.debian.org/

The result can then be parsed with dose3.

cheers, josch


--
To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/20130827084250.5326.87466@hoothoot



Re: asking for advice: all dependencies incl. version numbers

2013-08-23 Thread Johannes Schauer
Hi,

Quoting FARKAS, Illes (2013-08-22 17:47:57)
 I'd like to download/parse for each version of each debian package which
 other package versions it depends on. 
 
 Do you think this information available in managable formats?

In addition to the information Joachim already gave, let me specifically point
you at dose3. It is a framework for working with dependencies and allows you to
parse Packages.bz2 and Sources.bz2 files, create all kinds of dependency graphs
and analyze them and includes a solver for package relationships.

 Have you seen similar work before?

Joachim was pointing you at edos. There exists the tool edos-debcheck (or
edos-distcheck as a more general tool) in the main archive. But instead you
might want to look at the dose3 tools which supersede the edos tools. More
specifically you want to look at the binary packages built from the source
package dose3. The dose-extra binary package contains a tool called ceve which
allows you to build many different kinds of dependency graphs from a
Packages.bz2 file. Maybe this gives you the information you need.

Contact me if you have any trouble.

cheers, josch


--
To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/20130823094312.4755.71787@hoothoot



Re: asking for advice: all dependencies incl. version numbers

2013-08-22 Thread Joachim Breitner
Dear Illes,

Am Donnerstag, den 22.08.2013, 17:47 +0200 schrieb FARKAS, Illes:

 This is a researcher asking for advice.
 
 
 I'd like to download/parse for each version of each debian package
 which other package versions it depends on. 
 
 
 Do you think this information available in managable formats?

It is all in the Packages file, e.g.
ftp://ftp.de.debian.org/debian/dists/unstable/main/binary-amd64/Packages.bz2

It is a simple text file format and there are parsing libraries for
various programming language around. If you are more specific about your
goals and needs, I can give more specific advise.

 Have you seen similar work before?

The researches at IRILL have done lots of work on Package relationsships
and also created useful tools to investigate that. I don’t have a good
entry page to send you to, but I guess http://www.mancoosi.org/edos/ and
http://www.mancoosi.org/ are of relevance.

Greetings,
Joachim


-- 
Joachim nomeata Breitner
Debian Developer
  nome...@debian.org | ICQ# 74513189 | GPG-Keyid: 4743206C
  JID: nome...@joachim-breitner.de | http://people.debian.org/~nomeata




signature.asc
Description: This is a digitally signed message part