RE: repo security

2005-01-12 Thread Noel J. Bergman
 One thing I'd like to see is *every* JAR signed w/ certs under a
 single CA, say the Maven one.

Well, we have an ASF CA, which I would trust.  Talk with Ben Laurie about
it.

--- Noel



RE: Maven and repository@apache.org

2005-01-05 Thread Noel J. Bergman
 IMO we should [make] the Maven artifact handling better
 and used by all Apache and non-Apache projects.

Is Maven willing to provide suitable support for Ant to use it?  I just want
to make sure that this is not the Maven repository, but is THE repository.
Tool-agnostic.

--- Noel



RE: Cron mdiggory@tribal /export/sunsite/users/mdiggory/bin/sync-apache

2004-08-15 Thread Noel J. Bergman
 The only issue I can see is that the From address is [EMAIL PROTECTED]

I will leave it to you to figure out.  When you've done, please let me know.
Right now I have to moderate these through.  I'll add it to allow list after
you're done fixing the address, although it it ends up being yours, I won't
have to worry about it.

--- Noel



RE: Cron mdiggory@tribal /export/sunsite/users/mdiggory/bin/sync-apache

2004-08-14 Thread Noel J. Bergman
 Just doublechecking, did everyone on the repository list recieve this?

Yes.  Was this by accident, or something you wanted coming to the list now?

--- Noel


RE: adding jaxme jars

2004-03-11 Thread Noel J. Bergman
 jaxme would have been out of incubation by now but there are some major
 hassles with procedure.

No, there was a vote taken.  It was then redone a day later in a public
forum.  Hardly a major hassle, nor a significant delay.

--- Noel



RE: [maven] developer repository?

2003-12-20 Thread Noel J. Bergman
Matthew,

re:
http://nagoya.apache.org/eyebrowse/[EMAIL PROTECTED]
he.orgmsgNo=40252

See [EMAIL PROTECTED]  There are already a group trying to do this
work.  Tim Anderson, for one, has done a superb job, as have others.  If you
can help herd the various projects that would be good.

--- Noel



RE: licensing issues for virtual artifacts (was RE: click through license support?)

2003-11-26 Thread Noel J. Bergman
Nicola Ken Barozzi wrote
 [EMAIL PROTECTED] wrote:
  I'm failing to see the requirement for us to do [virtual artifacts]
*now*.
 Because Apache projects using the repository would need also non-asf
 jars that we don't want to distribute - virtual artifacts.

I still maintain that non-ASF jars are specified in meta-data made available
to client tools, and thus virtual artifacts are unnecessary.

The meta-data files will need to be present repository in order for the
tools to work.

--- Noel



RE: licensing issues for virtual artifacts (was RE: click through license support?)

2003-11-22 Thread Noel J. Bergman
 Suppose ASF has the following link in the repository:
   http://repo.apache.org/sun/jndi/1.2.1/jars/jndi-1.2.1.jar
 This is a virtual artifact, not hosted at ASF.

I do not like the idea of virtual artifacts.  I think that the meta-data for
any component that needs a foreign artifact should contain the information
needed by some tool.  I don't think that we want to include foreign
components in the ASF namespace.  In fact, there is a situation right now
where someone else has done that to the ASF, and we're not happy about it.

--- Noel



RE: click through license support?

2003-11-18 Thread Noel J. Bergman
 I'm taking about downloading the whole thing from the sun site as
 users manually do. So there is effectively no distribuition
 difference.

You would have to pass through the license request to the user.  It would be
a bad idea for the tool to pose as a user without requiring user approval of
the actual license.

Not sure if you've already said that; just making sure that it gets noted.

Nick has a point that this is more of a tools discussion.  Any reference to
a click-through license would come from meta-data describing the location of
a dependency.

--- Noel



RE: Use of '/' in ???-specifier's

2003-11-16 Thread Noel J. Bergman
 maybe the [organization]/[product] notion is artificial.
 What [organization]/[product] and [organization]/[product]/[version]
 do is to establish a path to an logical artifact.

At any of it does is establish a path to a logical artifact.  Seems to me
that there is limited utility to being able to parse the URI, and that the
real key is having meta-data with which to assemble it.  But others don't
seem to agree with that view.  They want to parse semantic information from
the URI.

 we should not be focussing on the url as a spec - but instead
 we should be focussing on the url as a [artifact-identifier]
 and from that point on we should be using metadata to provide
 us with the information about organization, product name,
 available versions, etc.

So your feeling is that once you have a URI for the root component for a
tool, you want meta-data suitable for your tool to indicate the location(s)
of other content, such as license, dependents, etc.  Those location(s) can
be specified either by a full URI, or after all of Tim's good work, by URI
parts, which the specification tells us how to assemble.  The latter is how
I have been viewing things so far.

The meta-data could be in the form of a POM, a JNLP file, or some other
format, and the tool would indicate what it is looking for as previously
discussed.  I think that's where you're going, right?

 I'm not keen on being the odd-guy out

I don't think that you are.  There may be some undocumented assumptions
going on, and this helps to clarify them.  For example, the above may help
explain to Adam why I have been unconcerned about the ability to
unambiguously parse a URL, whereas I do care about being able to assemble
one.

--- Noel



meta-data formats

2003-11-16 Thread Noel J. Bergman
Stephen,

  The meta-data could be in the form of a POM, a JNLP file, or some other
  format, and the tool would indicate what it is looking for as previously
  discussed.  I think that's where you're going, right?

 In principal ... yes.

 But I am making an assumption that a very simple named value pair
 metadata syntax could be assumed along with a meta mime type.
 References in that structure could be absolute or relative to the
 location of the metadata file.

That would be a possible meta-data format, but there are already others,
such as Maven's POM or Sun's JNLP.  The goal, IMO, would be to provide
suitable content appropriate to the requesting client.  I think we need to
facilitate the mechanism, not dictate the possible meta-data formats.

--- Noel



RE: [proposal] URI Syntax - v0.2

2003-11-15 Thread Noel J. Bergman
  However, I don't think this is unreasonable. There is no requirement
  that tools be able to parse URIs to extract meta-data.

 There is a requirement that repositories work (at some minimum level)
 without metadata, especially since we aren't specifying metadata.
 Without a parsable URI (or parsable URL) how do tools read a repository
 to do things like clean oldest nightly/snapshot, but leave all releases,
 download latest release or even the basics determine/display contents,
 show basic contents (irrespective of version/type).

Adam, and how is said tool going to start in the first place?  Without
meta-data, there is a limit to what the tool can do.  Basically, it would
have to operate relative to the URL provided to it.

As for the particular examples you gave, those carry semantic meaning that
would require more specification that is contained in the URI syntax.
Although those would be desirable, I don't know that we want to including
that kind of semantic specification in the URI.

 If we are proposing a standard, there has to be a valid purpose for it
 -- and having a standard that isn't structured for computer processing
 seems setting the bar pointlessly low.

Tim's URI schema supports your operations when combined with with a semantic
layer, which can be implied or meta-data based.

 For me, the strongest argument for tooling (other purely than saving
admins
 effort) is download + verify (MD5/whatever).

That does not require the kind of semantic your earlier operations require.
The verification content can be relative to the URI provided to the tool.

--- Noel



RE: [proposal] URI Syntax - v0.2

2003-11-15 Thread Noel J. Bergman
 My input here is primarily based on writting Ruper

 You don't have to like the tool, I'm not trying to push the implementation

I've never even seen the thing, and you are a priori assuming that I don't
like it?

 It allows you to query what is there, query and capture oldest resources
 [and do a delete/clean], and download newest, etc.

How does it know what OLDEST means?  I see that Tim is trying to add some
more structure, so maybe he's thinking that we can restrict the URI space so
that a restricted notion of version assures an automatable concept of
succession.

 Some find such a tool useful, I'd like to believe that apache users
(admins
 and external users) would find it useful.

I don't disagree.  I simply said that if you view the repository solution as
a layer of specifications, the lowest layer can be a syntax that does not
require semantics such as an automatable concept of succession.  If we need
that, we can add it either by a convention within the URI space, or by other
means.


[I sometimes feel the acadaemics of the URI Scheme Specifiecation are
outweighing the practicalities of an implementation. I beleive in writting a
specification first, but specifications get revised based upon real world
experience. Tools are that experience.]

 I'd like to say go get me xerces from any repository it is in,
 but get me the latest, but I only want release not nightly/snapshot
 That to me, is useful.

Absolutely.  But that may require something more than the URI schema.  :-)

 I feel we have the potential to win big, and I'd like the ASF
 Repository to be a step forward towards these goals, not a step backward.

I agree.  But one layer at a time.  :-)

--- Noel



RE: repository@ awareness?

2003-11-12 Thread Noel J. Bergman
 You're saying that those interested in enabling a repo with
 metadata and searches based on this metadata could wrap the
 repository with a servlet.

Could?  Yes.  But that is just one way of many.  I maintain that httpd could
serve the content of most repositories, meta-data and all, without dynamic
content generation.

 The URI could be used by the servlet to give a different view
 of the repository based on [criteria embedded in the request]

IMO, the request should to encode the complete request.  There should not be
any other implied context.

 the servlet manages the interaction behind the scenes with
 some sort of metadata database to conduct the query and
 return the results as if they were regular files on the
 server's repo file system.

It depends upon the repository implementation.  It could work as you
describe, or there could just be pre-built metadata stored in files.

Consider that eventually web sites will likely use Subversion with WebDAV as
their authoring mechanism.  Authorized people will post directly to a
Subversion repository.  Although httpd can load directly from Subversion,
that will not be as efficient as serving directly from the file system.  The
reason for that is that sendfile() does not work directly out of a BDB
database (as far as I know).  Therefore, when a file is posted to
Subversion, it could be mirrored by a hook to a directory representing the
current content, which is what would then be served by httpd.  We used a
similar technique at GEIS years ago with SourceSafe, so that when a checking
occurred, a copy went into a shadow directory, and a build test was
initiated.  Likewise, a tool could be invoke to build meta-data, and store
it in the file system.

So there are ways and ways and more ways.  The goal is the same, as should
be the externally viewable behavior.

--- Noel



RE: repository@ awareness?

2003-11-11 Thread Noel J. Bergman
Justin,

 Is anyone on infrastructure@ aware of what's going on in [EMAIL PROTECTED]

Not from what I see on the subscriber list, which is why I have suggested on
more than one occassion that such participation is important.

 Apparently, AFAICT, that list is supposed to allow for Java-based
 distribution of software.  Other than that, I'm completely lost as
 to what that list is for.

Eventually, it would be desirable to have a user-friendly tool that is
capable of picking up, for example, httpd source, tomcat, and other parts,
and doing a platform-specific install.  But the tool is someone else's
problem.  The only thing that the repository needs to do is provide a
non-fragile URI space for artifacts, of which files and, eventually,
metadata are both examples.

 Do any 'core' infrastructure people need to get involved to help guide
with
 what's practical or not?

Yes.

 With a quick perusal of [EMAIL PROTECTED], I got the sense that they
 might be out in la-la land

Agreed.  The discussion on [EMAIL PROTECTED] was getting into tool areas
that should be relatively orthogonal to the repository.  There are three
areas:

  - URI space
  - metadata
  - tools

The first is the main issue that the repository needs to address.  The
second is an area where after we have decided upon the URI space, the tool
groups could use the repository list as a gathering place to seek common
ground.  And then there are tools, which belong elsewhere, but use the
repository.  Some people are jumping ahead to tools before the URI space is
resolved.

 The people advocating a file layout *only* get my uninformed +1.)

I think that most people recognize that the file layout only approach to
the URI space is necessary.  meta-data is present in the URI space, and can
be implemented with a static file.  Even if we want to key off the
user-agent for meta-data, that can still be served with static content in
the file space.

--- Noel



RE: repository@ awareness?

2003-11-11 Thread Noel J. Bergman
Stephen McConnell asked:

 File system - a convenient and simple solution - but should a file
 system driven approach be the basis for the next generation?

The basis is a URI space.  Whether a URI is efficiently served by a static
file, or by some servlet, CGI or Grandma Moses typing very VERY fast really
should not be visible to the user-agent.

 A solution must be implementation independent

See: http://www.w3.org/Provider/Style/URI.html

The URI is a request for content.  It should not change, regardless of the
means by which the content is generated.

 So why a preoccupation with meta-less file system structures as opposed
 to a preoccupation with an extensible repository protocol?

The extensible repository protocol is HTTP.  Nothing else needs to be
visible.  The only thing that the infrastructure team needs to deal with is
the implementation of the URI space (allowing that the content addressed by
a URI can vary based upon the user-agent).

--- Noel



RE: [Possible Incubation] Apache Repo

2003-11-09 Thread Noel J. Bergman
 Neither you or I are any great shining examples of an
 ideal collaborator. You'll have to bear with me while
 I try to make ammends. I will try to bear with you.

Let take this at face value: someone admitting to faults, pledging to
improve, asking for allowances while making even more mistakes in the
interim, and offering the same in return.

Few people cannot stand to improve their inter-personal communication.

--- Noel



RE: Proposals

2003-11-09 Thread Noel J. Bergman
peter royal wrote:
 On Nov 7, 2003, at 5:37 PM, Stephen McConnell wrote:
  Searching is certainly on the my agenda.  We need it for IDE related
  development, repository management, and intelligent query based
  artifact aquisition (and HTTP in this context is not an ideal
  solution).

 But that's a layer that would sit on top of the repository, right?

That is my thought as well.  First we need a layout, of which I like Tim's
the best so far.  On top of that we can add meta-data, and then tools that
use the meta-data.

For dumb servers, we can have tools that create static meta-data, which
would also be more efficient.  Smart servers might support dynamically
creating, or simply reformatting, meta-data for different clients, e.g.,
Maven, Avalon or JNLP, from a single source, but otherwise we just store
meta-data statically.  The real smarts would be on the client side, where
the metadata would be most often used.

But since the meta-data would be present at a URL within the layout, I don't
think that we need to deal with it right now.  Just the layout, itself,
which can be presented to infrastructure and the projects.  Once we've a
layout, existing tools can make use of it, and people can start discussing
the next layer, which would be meta-data.

At least that's my view.  :-)

--- Noel



RE: URL Syntax parts

2003-10-31 Thread Noel J. Bergman
I would prefer to NOT have the TLP represented in the URI if possible.
Projects can be promoted.  The package name for James was always
org.apache.james, and so did not change when the project was promoted.

Point being that I'm not sure if the URI should reflect the ASF
organization.  A project name ought to be unique across the ASF.

--- Noel



RE: New lists in eyebrowse

2003-08-10 Thread Noel J. Bergman
Brian Behlendorf wrote:
 On Sun, 10 Aug 2003, Noel J. Bergman wrote:
  The requested list [EMAIL PROTECTED] has not been added because
there
  is no directory for it under daedalus:/www/www.apache.org/mail/.
 What's this list about?  I see you listed as a moderator, is it intended
 to be a public list?

Although it has been idle, that list is regarding an Apache repository,
suitable for Maven and other tools, and not language specific.  As I recall,
there was some decent stuff on there before it went quiet.

I don't know of any reason for it to not be public, but I'm cc'ing the list.

--- Noel