On Wed, Dec 06, 2000 at 08:42:55PM +0000, Stevan Harnad wrote:
> Can I switch metaphors? (As a vegetarian, I regret the lurid one I
> chose.) The analogy with food quality control (let us say, mushrooms),
> is that the inspectors decline to certify a grower's mushrooms
> ("preprints") as "fit for human consumption" until the grower does
> whatever is required to produce mushrooms to that standard
> ("postprints").You still don't rename them. It's not as if they are toadstools before certification and mushrooms after. And I see a substantive point behind this semantic one. A safety measure is not usually so inviolate that it makes sense to rename the object of scrutiny. There are people who divide society into "people" and "criminals". Surely you would agree that that is belligerent terminology. > > In mathematics informal review by self-appointed experts --- what you > > called vigilantism --- works pretty well. Most mathematicians are much > > more worried that any other mathematician might find a devastating > > error in one of their papers, published or not, than that the papers > > will be rejected by journals. > I am ready to believe you; but is it churlish of me to keep asking for > the evidence? I already gave what I consider evidence, although I wouldn't it expect it to sweep away deep skepticism. > and to wonder why, if this is so, mathematicians keep > submitting the "vast majority" of their work to the journals for > refereeing and certification anyway, for all the world EXACTLY like all > the other disciplines? In my case, to get promoted. My own department is qualified to judge letters of recommendation, which are an outgrowth of informal peer review of my papers. But the higher administration is not. The administration has taken ritualized peer review as a standard, even though the ritual has sometimes degenerated. > > research in mathematics is... > > rigorous enough that self-appointed critics > > can quickly earn credibility. > > Will this sort of anecdotal phenomenon scale, even within mathematics, > let alone the rest of the disciplines? This is more than an incidental anecdote; this is the daily diet in my profession. If you don't believe me, you should take a survey of mathematicians to see if they have ever worried that someone might find a mistake, or a trivializing shortcut, when they give a talk. Maybe not all mathematicians are afraid of that, but if your survey wouldn't find many then I must be living on the wrong planet. > > One interesting consequence of the [permanence] policy is that you > > can search for all of the "withdrawn" papers, meaning those in which > > the latest version begs the reader not to read previous versions: > > > > http://front.math.ucdavis.edu/search/withdrawn > > > > One proposed name for this list is "The Avenue of Broken Dreams". > > Do you consider this to be an incentive toward self-archiving, in > general? In mathematics and hard science, absolutely. In other disciplines, I don't know, but it could have merit. There was a notorious affair in which a mathematician claimed a proof of the Kepler sphere-packing conjecture, and even got it published in an otherwise respectable journal, even though none of the real experts thought that he had even come close. One of the problems in his case was that he managed to hide certain blatant mistakes by discarding early drafts of his preprints. And by throwing away the drafts he also (falsely) undermined the criticisms of those drafts. More recently a friend of mine named Tom Hales finished what could be a solid proof of the same conjecture. I persuaded Tom to contribute his work to the arXiv, and one of my arguments was that by doing so he would really put his money where his mouth is. I have heard, by the way, that the journal wants Tom to completely rewrite his proof, not because of mistakes but for the sake of exposition. So the arXiv may become the only permanent record of his *first* proof. See http://front.math.ucdavis.edu/author/hales > > I know that your explanation of this evidence is the "invisible > > hand theory". I grant you that the journals do extend an invisible > > hand into the arXiv and that it does help some to uphold standards. > > But I believe that it is a relatively weak hand. I think that the onus > > is on the proponents of the invisible hand theory to prove its strength. > I'm afraid I disagree about where the onus is (as I suggested in the > analogy about where the onus is in the question of whether or not there > is any point in continuing to have police in the neighbourhood). There is some truth in that analogy, since many people say that police only look effective when people want to obey the law anyway. The invisible hand again. I think that the invisible hand principle is at best a compromise between self-policing and formal authority. > Since we both think freeing the literature would be a good thing, > perhaps we should devote our efforts to doing whatever we can to > facilitate and accelerate that... In my opinion reform of peer review would indeed accelerate the open archiving movement. -- /\ Greg Kuperberg (UC Davis) / \ \ / Visit the Math ArXiv Front at http://front.math.ucdavis.edu/ \/ * All the math that's fit to e-print *
