Re: proposed change to getty

[matthew sporleder]

On Tue, Oct 12, 2021 at 4:33 AM Robert Elz  wrote:
>
> Date:Mon, 11 Oct 2021 18:09:23 -0300 (ADT)
> From:Jared McNeill 
> Message-ID:  <5ab793c9-8cab-2e79-e6ba-8017d924b...@invisible.ca>
>
>   | There's a 2 second sleep in getty before opening the tty
>   | that has been there since before NetBSD
>
> I don't recall if that was there when this
> version of getty was created or not -- probably,
> in which case it was probably also in the 7th
> edition getty.   That all got done about 40
> years ago, far too long to remember.
>
> 2 secs back then was the smallest sleep that
> was guaranteed to be > 0 (the delay for sleep(n)
> was between n-1 and n secs).  Since that is
> no longer true, the smallest change that should
> happen is s/2/1/, or use usleep() or nanosleep()
> and make the delay even smaller, 200ms should
> be enough for any modem.
>
> Doing it in the driver is OK as well, but
> probably needs to remain in getty until we are
> sure that all drivers do this correctly.
> Since you are handling this by blocking open
> until long enough after the close had passed,
> also delaying the open in getty should have
> no real effect.
>
> kre

Do you mean modem like a telephone modem or modem like a serial port?

Re: A proposal for code explanation sessions

[matthew sporleder]

This is a really fun idea.  Twitch and youtube make the most sense for sure.

On Wed, Aug 18, 2021 at 7:15 AM Rocky Hotas  wrote:
>
> Hello!
>
> During this year's NetBSD Annual General Meeting on IRC (May 22nd),
> several participants suggested the activation of some code tutorial
> sessions performed by the developers.
>
> NetBSD sourcecode is in fact still a mysterious place for the new
> users, or just for those who read it for the first time. According
> to the chat, it would be great if some developer could show how they
> work on the sourcecode, for example with a live session, with any
> mean: a Youtube live, or even just an IRC live session.
>
> This arouse several difficulties: not only as regards the lack of
> time, but also the difficulties involved in understanding what a
> developer is doing (some automated operations, with obvious meaning
> for a skilled developer, are meaningless for someone else).
>
> I would like to re-open this discussion and, in particular, I would
> like to suggest something maybe simpler. Instead of explaining why
> some portion of code is being updated and how, it would be very
> useful to show and explain the code just as it is. For example, a
> volunteer developer could take an important, well known sourcecode
> file, and explain it line by line; as a starting trivial file,
> something like src/bin/hostname/hostname.c can be considered, then
> moving to something more complicated like src/sbin/init/init.c.
>
> While I'm sure it's not possible to actually explain every line,
> the principles used to write the code "that way", to place that
> function in that point, to call that function with those argument
> values, could be shown.
>
> I believe that some gentle introduction to kernel code would be
> extremely useful to the whole community, giving anyone more means
> to craft the code by himself, to improve it, to learn and eventually
> (why not?) to become a developer. It would be a huge enhancement
> for an "open-source" community, because the code would not only be
> available, but also comprehensible.
>
> What do you think about it? Would some developer be available for
> this?
>
> Bye!
>
> Rocky

Re: Scripting for /bin/ksh

[matthew sporleder]

On Mon, Aug 2, 2021 at 8:23 AM Todd Gruhn  wrote:
>
> I am attempting to write some ksh-scripts that invoke "borg" .
> How does one tell ksh to cat the 2 vars together and invoke the
> resulting command?
>
> $foo  <--> /umass1/BORG-REPOS
> $FIRSThalf <--> borg-3.8 list
> $cmd= $FIRSThalf  . $foo  #thats how it is coded in PERL
>
> execute $cmd
>
> I never learned much about /bin/ksh -- I jumped straight into PERL.
> Anyone know of some good PDFs regarding this?
>
> Any help will be appreciated.


foo="ls"
bar="/tmp"
cmd="${foo} ${bar}"
${cmd} #runs ls /tmp
---
output=$(${foo} ${bar}) #captures the output

not sure what "execute" is here

Your perl code wouldn't work because you don't have spaces using the `.`

working perl (looks just like the shell script):
perl -e '$foo = "ls"; $bar = "/tmp"; $cmd = "${foo} ${bar}"; print qx#$cmd#;'

Re: getting pkgsrc-wip with CVS

[matthew sporleder]

You unzip it and rename the directory to 'wip' under pkgsrc/ as if it
were a category

On Mon, Jun 14, 2021 at 6:36 PM Todd Gruhn  wrote:
>
> I got pkgsrc-wip, and unzipped it. I get the error:
>
> line 16: could not find ../../graphics/gd/buildlink3.mk
>
> Where do I unzip  pkgsrc-wip?
>
> On Mon, Jun 14, 2021 at 5:38 PM matthew sporleder  
> wrote:
> >
> > You may use: 
> > https://github.com/NetBSD/pkgsrc-wip/archive/refs/heads/master.zip
> >
> > On Mon, Jun 14, 2021 at 1:34 PM Todd Gruhn  wrote:
> > >
> > > Thats fine. I just dont care to learn git.
> > >
> > > On Mon, Jun 14, 2021 at 1:30 PM Greg Troxel  wrote:
> > > >
> > > >
> > > > Todd Gruhn  writes:
> > > >
> > > > > On Sun, Jun 13, 2021 at 6:04 PM Benny Siegert  
> > > > > wrote:
> > > > >>
> > > > >> On Sun, 13 Jun 2021, Todd Gruhn wrote:
> > > > >>
> > > > >> > Is it possible to get  pkgsrc-wip using cvs ?
> > > > >>
> > > > >> No. You have to use git.
> > > >
> > > > > Rats
> > > >
> > > > If there's an actual problem using git, I'd be interested in hearing
> > > > about it.  If you just choose not to use it, or haven't spent the few
> > > > hours to be able to start, then that's of course your call, but I don't
> > > > see it as a pkgsrc-wip problem.   Lots of people have been getting
> > > > pkgsrc-wip and contributing and overall things seem fine, as far as I
> > > > can tell.

Re: getting pkgsrc-wip with CVS

[matthew sporleder]

You may use: https://github.com/NetBSD/pkgsrc-wip/archive/refs/heads/master.zip

On Mon, Jun 14, 2021 at 1:34 PM Todd Gruhn  wrote:
>
> Thats fine. I just dont care to learn git.
>
> On Mon, Jun 14, 2021 at 1:30 PM Greg Troxel  wrote:
> >
> >
> > Todd Gruhn  writes:
> >
> > > On Sun, Jun 13, 2021 at 6:04 PM Benny Siegert  wrote:
> > >>
> > >> On Sun, 13 Jun 2021, Todd Gruhn wrote:
> > >>
> > >> > Is it possible to get  pkgsrc-wip using cvs ?
> > >>
> > >> No. You have to use git.
> >
> > > Rats
> >
> > If there's an actual problem using git, I'd be interested in hearing
> > about it.  If you just choose not to use it, or haven't spent the few
> > hours to be able to start, then that's of course your call, but I don't
> > see it as a pkgsrc-wip problem.   Lots of people have been getting
> > pkgsrc-wip and contributing and overall things seem fine, as far as I
> > can tell.

Re: getting pkgsrc-wip with CVS

[matthew sporleder]

How did you get it?  They should be generated on the fly (although
possibly cached at cdn)

On Mon, Jun 14, 2021 at 7:31 AM Todd Gruhn  wrote:
>
> How often do the snapshots update? I got one last night.
>
> On Mon, Jun 14, 2021 at 12:02 AM Martin Husemann  wrote:
> >
> > On Sun, Jun 13, 2021 at 02:46:28PM +, Todd Gruhn wrote:
> > > Rats
> >
> > You can download a snapshot with your browser though.
> >
> > Martin

Re: Daemonizing processes in NetBSD

[matthew sporleder]

On Tue, Feb 16, 2021 at 1:37 PM Bartek Krawczyk
 wrote:
>
> Hi,
> is there any program in base which allows to daemonize programs which
> don't detach from console, don't have any "-daemon" option etc.? There
> are sysutils/daemond and sysutils/daemonize in pkgsrc of course but do
> we have anything like "daemon" in FreeBSD base?
>
> As a workaround I'm using "&" from /bin/sh at the moment.
>


Classic nohup ./prog 2>&1 & should be an upgrade to what you are
currently doing, then :)

Re: sponsor NetBSD for 2020 https://github.com/sponsors/NetBSD

[matthew sporleder]

Indeed -- casting a wide net is in our interest.  I hope you are able
to use one of our many potential donation offerings -- paypal, stripe,
amazon smile, github sponsorship.. any I am missing?

On Tue, Nov 10, 2020 at 7:55 AM Sad Clouds  wrote:
>
> On Tue, 10 Nov 2020 12:31:26 +0100
> Matthias Petermann  wrote:
>
> > Hallo Matthew,
> >
> > Am 10.11.2020 um 05:35 schrieb matthew sporleder:
> > > Hey -- the end of the year is coming up fast.  Wouldn't you feel
> > > better about yourself if you added a github sponsorship to balance
> > > out your incredible year? :)
> > How does this type of donation compare to a Paypal Monthly
> > Subscription? Is it just a different way of transport, or are there
> > advantages / disadvantages to Paypal?
> >
> > Kind regards
> > Matthias
>
> It looks to me like github sponsorship is geared towards small
> developers who don't have their own project web page, with
> payment submission links, etc. The irritating thing about github is
> that they don't allow you to submit bug reports or donations unless you
> setup an account on their platform. Last thing I want to do is to create
> various social media accounts on competing platform - GitHub, GitLab,
> SourceForge, Bitbucket, GNU Savannah, ... and the list goes on. Life is
> too short for that nonsense. Luckily NetBSD accept bug reports and
> donations on their official web site, and you don't have to sign up for
> anything.

Re: sponsor NetBSD for 2020 https://github.com/sponsors/NetBSD

[matthew sporleder]

On Tue, Nov 10, 2020 at 6:31 AM Matthias Petermann  wrote:
>
> Hallo Matthew,
>
> Am 10.11.2020 um 05:35 schrieb matthew sporleder:
> > Hey -- the end of the year is coming up fast.  Wouldn't you feel
> > better about yourself if you added a github sponsorship to balance out
> > your incredible year? :)
> How does this type of donation compare to a Paypal Monthly Subscription?
> Is it just a different way of transport, or are there advantages /
> disadvantages to Paypal?
>
> Kind regards
> Matthias

It is my understanding, although it hasn't been confirmed by
finance-exec@, that microsoft is absorbing the fees for us.

I am also intrigued by the potential network effects of sponsors
encouraging more sponsors, etc.

sponsor NetBSD for 2020 https://github.com/sponsors/NetBSD

[matthew sporleder]

Hey -- the end of the year is coming up fast.  Wouldn't you feel
better about yourself if you added a github sponsorship to balance out
your incredible year? :)

Do you live in one of these places?

Australia
Austria
Belgium
Canada
Cyprus
Czech Republic
Denmark
Estonia
Finland
France
Germany
Greece
Hong Kong SAR
Ireland
Italy
Japan
Latvia
Lithuania
Luxembourg
Malta
Mexico
Netherlands
New Zealand
Norway
Poland
Portugal
Singapore
Slovakia
Slovenia
Spain
Sweden
Switzerland
United Kingdom
United States of America

then sign up: https://github.com/sponsors/NetBSD

A little while ago we added some very low tiers so it's not a lot of
money at all!

Re: Checking out src with Mercurial

[matthew sporleder]

On Sun, Jun 21, 2020 at 12:36 PM Mayuresh  wrote:
>
> On Sun, Jun 21, 2020 at 11:56:20AM -0400, matthew sporleder wrote:
> > > 
> > > the way git works (tracking whole trees at a time, never single files),
> > > that ends up being very painful, because it's an "all or nothing"
> > > approach.
> > >
> > > So I'm hoping that if you guys are seriously considering git, you'd also
> > > split up the KDE repository so that it's not one single huge one, but with
> > > multiple smaller repositories
> > > 
>
> Just so that above point is not missed. Above point is not out of date. It
> applies to both hg and git - splitting a large repository when using
> distributed ones.
>
> > This is out of date.  FreeBSD is moving to git.
>
> Interesting... I could not find that in official documents as yet. Yes,
> there have been git mirrors.

The last two status reports:
"The Core-initiated Git Transition Working Group continued to meet
over the last quarter of 2019. Their report is still forthcoming. "

https://www.freebsd.org/news/status/report-2020-01-2020-03.html

Re: Checking out src with Mercurial

[matthew sporleder]

On Sun, Jun 21, 2020 at 11:33 AM Mayuresh  wrote:
>
> On Sat, Jun 20, 2020 at 11:35:53AM +0530, Mayuresh wrote:
> > On Fri, Jun 19, 2020 at 10:01:35PM -0700, Greg A. Woods wrote:
> > > (c) modern change tracking tools try to track changes to whole sets of
> > > files at once, so if you have lots of files, and lots of history,
> > > this combinatorial problem can sometimes bite at a bad time for the
> > > user of a tool trying to manage it all.
> >
> > In one of the talks by Linus on git I heard him recommending breaking very
> > large repositories into some smaller units to get better performance.
> >
> > Would it be something feasible in NetBSD? A single user requires
> > approximately what % of code from what he or she checks out to be actually
> > compiled and can there be 1 core and several optional repositories that
> > would increase this percentage.
>
> Just quoting the correct reference[1]:
>
> 
> the way git works (tracking whole trees at a time, never single files),
> that ends up being very painful, because it's an "all or nothing"
> approach.
>
> So I'm hoping that if you guys are seriously considering git, you'd also
> split up the KDE repository so that it's not one single huge one, but with
> multiple smaller repositories
> 
>
> I think, before we adopt a centralized repository (whether hg or git) this
> needs to be thought through.
>
> FreeBSD has been there done that when adopting SVN[2],[3]
>
> [1] https://lwn.net/Articles/246381/
> [2] https://wiki.freebsd.org/VCSWhy
> [3] https://wiki.freebsd.org/GitDrawbacks

This is out of date.  FreeBSD is moving to git.

Re: cvs better than git?

[matthew sporleder]

> On Jun 21, 2020, at 10:32 AM, g...@duzan.org wrote:
> 
> 
>> 
>>> On 2020-06-21 16:07, Rhialto wrote:
>>> On Sun 21 Jun 2020 at 15:20:39 +0200, Johnny Billquist wrote:
 I am still curious about how to manage well in git the scenario where
 you do
 have a central repository that holds the actual source of truth, and
 where
 you want to review and approve anything that gets committed.
>>> 
>>> Let me point you to the hell that is called "Gerrit"...
>>> Example: https://review.opendev.org/
>> 
>> Like I said. We are using gerrit. It's not without a bunch of issues all
>> on its own... :-)
>> 
>> Any other options around with similar functionality?
>> 
>>   Johnny
> 
>   Our group at work uses Gerrit. We have had some trouble maintaining it,
> so we have been considering moving to Bitbucket, which already exists
> in the company. Bitbucket seems nice enough, though of course it is
> commercial. If I were looking for a solution today I would consider
> Phabricator/Differential, as it is open source, supports Mercurial, and
> appears decent enough.
> 
>  Gary Duzan
> 
> 



People like gitlab 
> 

Re: Checking out src with Mercurial

[matthew sporleder]

> On Jun 19, 2020, at 3:51 PM, Johnny Billquist  wrote:
> 
> On 2020-06-19 20:19, matthew sporleder wrote:
>> git clone with --depth 1, over http (instead of ssh), and with a few
>> simple settings changes will make it work inside of 128M.
> 
> Well, the whole point of virtual memory and demand paging is that you don't 
> have to have enough physical memory. I would hope that still applies... My 
> comment about have 128M (which, by the way, can be considered a lot, when we 
> talk about VAXen), was just about the potential speed I possibly could 
> expect. If git really requires that people have at least 128M of physical 
> memory to work, then I'd first ask when did NetBSD break so badly that the 
> amount of physical memory becomes a limitation in this way, and second, why 
> would a tool like this require that much memory in the first place?
> 
>  Johnny
> 
> -- 
> Johnny Billquist  || "I'm on a bus
>  ||  on a psychedelic trip
> email: b...@softjar.se ||  Reading murder books
> pdp is alive! ||  tryin' to stay hip" - B. Idol


I don’t know what to tell you.  It works. 

I personally think running such an old and inefficient computer is, literally, 
immoral when a modern $30 machine can emulate it perfectly using as much 
electricity as a small CFL light bulb and leave over 700mb of memory to spare. 

Re: "hg clone https://anonhg.netbsd.org/src/" still aborts, but...

[matthew sporleder]

> On Jun 19, 2020, at 3:03 PM, Chavdar Ivanov  wrote:
> 
> On Fri, 19 Jun 2020 at 16:27, Steffen Nurpmeso  wrote:
>> 
>> Chavdar Ivanov wrote in
>> :
>> |I've been watching the discussion with interest, as I am not
>> |particularly verse in these topics; perhaps I've done something not
>> |correctly, but on my 6 years old laptop (4c8t, 20GB memory, core-i7
>> |3820-qm) the full ' hg clone https://anonhg.netbsd.org/src/' (on a ZFS
>> |placed on an mSATA device) took some 45-50 minutes; the resulting repo
>> |takes about 5GB. I am cloning xsrc right now and will go through a
>> 
>> More of that stuff please.  This is for you who make their money
>> with managing/creating internet infrastructure!
>> And for all the bored black, white, yellow and red teenagers,
>> their first world internet connection, consuming also while in
>> their Upper East Side apartment.
> 
> I beg your pardon, but I could not quite comprehend this remark.  My
> Internet connection is reasonably fast - cable 350mb/s - but the
> laptop is beyond a powerline adapter, so that limits the speed to
> about 130mb/s; there is no WiFi involved though.
> 
> Anyway, xrsc was also cloned, in three hours and two minutes the build
> from scratch was completed.
> 
> I'll retest on my cvs repo on the same machine - but on a SATA SSD - a
> clean build, just to compare the speed difference between zfs and ufs.
> 
>> 
>> |full build.
>> 
>> --steffen
>> |
>> |Der Kragenbaer,The moon bear,
>> |der holt sich munter   he cheerfully and one by one
>> |einen nach dem anderen runter  wa.ks himself off
>> |(By Robert Gernhardt)
> 
> Chavdar
> 
> 
> -- 
> 

I appreciate these works/don’t work but we would need more details from 
everyone to make it useful for troubleshooting and finding patterns. 

Re: Checking out src with Mercurial

[matthew sporleder]

On Fri, Jun 19, 2020 at 10:29 AM Johnny Billquist  wrote:
>
> On 2020-06-19 13:45, Matthias Petermann wrote:
> > Hi,
> >
> > some closing words from someone whose arguments in the previous thread
> > were more for Git...
> >
> > I have tried several times during the week to clone the NetBSD
> > repository using Mercurial. I had observed a high CPU load and an
> > apparently unfinished checkout. I tried again and now the experiences
> > have shifted somewhat positively.
> >
> > First a tip for everyone who has an unstable internet connection: The
> > effects appear more clearly with Mercurial, because in the current
> > constellation (internet bandwidth, speed of the anonhg server?, ) it
> > takes a few operations longer than Git and this increases the likelihood
> > of becoming a victim of network fluctuations during an operation. My
> > observation is that sometimes an error message (timeout) occurs and the
> > transaction is rolled back. In this case, everything called up to that
> > point is invalid and you have to start over. Depending on the phase, the
> > process does not seem to notice this when a network fluctuation occurs
> > and instead is stuck in a state in which 100% CPU is used without
> > noticeable progress. That was obviously also the cause of my original
> > experience, in which the cloning of src did not come to an end even
> > after 11 hours on a relatively modern i5 PC.
>
> [...]
>
> Considering that a cvs update on my VAX takes roughly 24 hours, I do not
> look forward to trying hg or git... :-)
>
> Anyone who dares take a bet on how long it will take, assuming things
> don't just timeout and die in the meantime?
>
> (It's a 4000/90 with 128M of ram, so nothing extremely slow, I doubt
> I'll ever try on the 8650 with 60M of ram and RA73 disks...)
>
>Johnny
>
> --
> Johnny Billquist  || "I'm on a bus
>||  on a psychedelic trip
> email: b...@softjar.se ||  Reading murder books
> pdp is alive! ||  tryin' to stay hip" - B. Idol


git clone with --depth 1, over http (instead of ssh), and with a few
simple settings changes will make it work inside of 128M.

I did it a few years ago.

Re: "hg clone https://anonhg.netbsd.org/src/" still aborts, but...

[matthew sporleder]

On Sat, Jun 13, 2020 at 7:14 PM matthew sporleder  wrote:
>
> On Fri, Jun 12, 2020 at 6:22 PM Greg A. Woods  wrote:
> >
> > At Thu, 11 Jun 2020 20:41:58 -0700, bch  wrote:
> > Subject: Re: "hg clone https://anonhg.netbsd.org/src/; still aborts, but...
> > >
> > > Nb: you’ll want to have an .hg/hgrc w a line:
> > > default = https://anonhg.netbsd.org/src
> > >
> > > ...so that in the future you can just “hg pull” from w/i that repo.
> >
> > Thanks for the tip -- I figured something would have to be set like that.
> >
> > Looks like it's not quite right though:
> >
> > $ cat .hg/hgrc
> > default = https://anonhg.netbsd.org/src
> >
> > $ hg incoming
> > abort: repository default not found!
> >
> > The manual section for "hg clone" does say:
> >
> >The location of the source is added to the new repository's .hg/hgrc
> >file, as the default to be used for future pulls.
> >
> > However hgrc(5) suggests the syntax might have to be a bit different,
> > more like a .git/config.
> >
> > Ah ha!  It looks like this has to be in the "[paths]" section, and MUST
> > NOT be proceeded by a tab or other whitespace (which .git/config allows):
> >
> > $ cat .hg/hgrc
> > [paths]
> > default = https://anonhg.netbsd.org/src
> >
> > $ hg incoming | head
> > comparing with https://anonhg.netbsd.org/src
> > searching for changes
> > changeset:   931876:26c8f37631b6
> > branch:  trunk
> > user:maxv 
> > date:Sat May 02 11:12:49 2020 +
> > summary: Remove unused.
> >
> > changeset:   931877:42596ac89b6e
> > branch:  trunk
> >
> > --
> > Greg A. Woods 
> >
> > Kelowna, BC +1 250 762-7675   RoboHack 
> > Planix, Inc.  Avoncote Farms 
>
> I have just updated the bundle manifest to use anonhg instead of cdn
> and *I* get the same issue.
>
> I am interested in other peoples' experiences but am glad that I've
> eliminated fastly from the equation.
>
> I've also tried making some changes to the apache config, trying a
> gzip bundle, and a few other variants.
>
> In the end I land on:
>
> files [>
>  ]  59368/440465 3h47mdestination
> directory: src
> applying clone bundle from https://anonhg.NetBSD.org/_bundles/src/matt-gzip.hg
> adding changesets
> adding manifests
> adding file changes
> transaction abort!
> rollback completed
> (sent 2 HTTP requests and 434 bytes; received 806 bytes in responses)
> abort: stream ended unexpectedly  (got 12392 bytes, expected 32768)
>
>
> Why would there be any network activity in the "files" stage at all?
> This entire bundles extension appears poorly architected or,
> ironically, poor for less performant systems.
>
> I think the curl + extract + pull is probably the only way forward.


one more datapoint is that I can't clone the mozilla source repo (also
a big one and also a big user of the built-in clone extension)

hgtest $ hg clone https://hg.mozilla.org/mozilla-central/ firefox-source -Uv
applying clone bundle from
https://hg.cdn.mozilla.net/mozilla-central/fa0afb4328103e7e61b98b3b2706891334eb2926.zstd-max.hg
adding changesets
adding manifests
adding file changes
transaction abort!
rollback completed
(sent 2 HTTP requests and 452 bytes; received 4673 bytes in responses)

So anyway I think it is safe to assume that it might just be hg clone
not working on small or slow hardware

--

FWIW I *was* able to do a clone without a bundle with this command:
hg clone --rev $(hg identify https://anonhg.netbsd.org/src/|awk '{
print $1 }') https://anonhg.netbsd.org/src/

I *think* that does a "shallow"(?) clone as I'm choosing to start at
the --rev from the last "identify" although I actually don't know what
I got except that the command finished.
This is probably much more work on the server side but I didn't measure.

Re: "hg clone https://anonhg.netbsd.org/src/" still aborts, but...

[matthew sporleder]

On Fri, Jun 12, 2020 at 6:22 PM Greg A. Woods  wrote:
>
> At Thu, 11 Jun 2020 20:41:58 -0700, bch  wrote:
> Subject: Re: "hg clone https://anonhg.netbsd.org/src/; still aborts, but...
> >
> > Nb: you’ll want to have an .hg/hgrc w a line:
> > default = https://anonhg.netbsd.org/src
> >
> > ...so that in the future you can just “hg pull” from w/i that repo.
>
> Thanks for the tip -- I figured something would have to be set like that.
>
> Looks like it's not quite right though:
>
> $ cat .hg/hgrc
> default = https://anonhg.netbsd.org/src
>
> $ hg incoming
> abort: repository default not found!
>
> The manual section for "hg clone" does say:
>
>The location of the source is added to the new repository's .hg/hgrc
>file, as the default to be used for future pulls.
>
> However hgrc(5) suggests the syntax might have to be a bit different,
> more like a .git/config.
>
> Ah ha!  It looks like this has to be in the "[paths]" section, and MUST
> NOT be proceeded by a tab or other whitespace (which .git/config allows):
>
> $ cat .hg/hgrc
> [paths]
> default = https://anonhg.netbsd.org/src
>
> $ hg incoming | head
> comparing with https://anonhg.netbsd.org/src
> searching for changes
> changeset:   931876:26c8f37631b6
> branch:  trunk
> user:maxv 
> date:Sat May 02 11:12:49 2020 +
> summary: Remove unused.
>
> changeset:   931877:42596ac89b6e
> branch:  trunk
>
> --
> Greg A. Woods 
>
> Kelowna, BC +1 250 762-7675   RoboHack 
> Planix, Inc.  Avoncote Farms 

I have just updated the bundle manifest to use anonhg instead of cdn
and *I* get the same issue.

I am interested in other peoples' experiences but am glad that I've
eliminated fastly from the equation.

I've also tried making some changes to the apache config, trying a
gzip bundle, and a few other variants.

In the end I land on:

files [>
 ]  59368/440465 3h47mdestination
directory: src
applying clone bundle from https://anonhg.NetBSD.org/_bundles/src/matt-gzip.hg
adding changesets
adding manifests
adding file changes
transaction abort!
rollback completed
(sent 2 HTTP requests and 434 bytes; received 806 bytes in responses)
abort: stream ended unexpectedly  (got 12392 bytes, expected 32768)


Why would there be any network activity in the "files" stage at all?
This entire bundles extension appears poorly architected or,
ironically, poor for less performant systems.

I think the curl + extract + pull is probably the only way forward.

Re: "hg clone https://anonhg.netbsd.org/src/" still aborts, but...

[matthew sporleder]

On Thu, Jun 11, 2020 at 11:34 PM Greg A. Woods  wrote:
>
> Just a wee while ago it was again mentioned that 'hg clone' would be a
> suitable way to download NetBSD sources, but I've been trying this off
> and on for over a month now and always end up with a failure and abort
> just like this attempt today:
>
> $ hg clone https://anonhg.netbsd.org/src/ h-NetBSD-src
> applying clone bundle from 
> https://cdn.NetBSD.org/_bundles/src/77d2a2ece3a06d837da45acd0fda80086ab4113c.zstd.hg
> adding changesets
> adding manifests
> manifests [> ] 751718/931876 
> 48m52s
> transaction abort!
> rollback completed
> abort: stream ended unexpectedly  (got 32754 bytes, expected 32768)
>
> So after reading the line of output again and noticing it's a URL I
> decided to try downloading th bundle directly.  This worked fine, taking
> about 3 minutes for me.
>
> I then did:  "hg init src && cd src && hg unbundle $bundle"
>
> The unbundle finally finished the first step (unpacking all 931,876
> changesets) after about 15 minutes and began on the manifests, just as
> with the clone operation did.
>
> The manifests then completed, unlike the attempts via the network,
> though I don't know how long that took, and now it's checking out
> 439,702 "file changes", saying it will be taking over 2hrs to complete.
> HG has the world's second-worst task time estimator though -- it's been
> waffling between 10 to 30 mins for the past hour or more (on the "files"
> step).
>
> Overall that's _STUNNINGLY SLOW_ compared to a "git clone" of the same
> NetBSD source tree -- especially since I've eliminated the network for
> the HG test case!
>
> I'll have to try an up-to-date "git clone" again to be compareing more
> apples-to-apples, but IIRC the "git clone" of the src tree works at
> least an order of magnitude faster on the same platform, and direct from
> the network.
>
> Perhaps this slowness is because even the initial clone attempt is/was
> working from the one big complete bundle-format file?  Does HG have any
> more efficient way to supply a clone?
>
> And also, why does the network clone fail, but a fetch+unbundle work?
>
> --
> Greg A. Woods 
>
> Kelowna, BC +1 250 762-7675   RoboHack 
> Planix, Inc.  Avoncote Farms 


curl 
'https://cdn.NetBSD.org/_bundles/src/77d2a2ece3a06d837da45acd0fda80086ab4113c.zstd.hg'
|md5
394158db5733b878963e9d6a5eb721d5

what did you get?  why does that clone fail?

Re: Where do I get the source tree tarball from?

[matthew sporleder]

https://github.com/netbsd/src/

On Thu, Jun 11, 2020 at 8:50 AM mayur...@kathe.in  wrote:
>
> On Thursday, June 11, 2020 05:34 PM IST, xpetrl  wrote:
>
> >
> >
> > On 6/11/20 1:27 PM, mayur...@kathe.in wrote:
> > > i wish to try-out martin huseman's response to my query and get down to 
> > > compiling the netbsd source tree under a gnu/linux distribution.
> > > where do i point my web browser to get the netbsd source tree?
> > >
> >
> > NetBSD guide, Chapter 30. Obtaining the sources:
> >
> > https://www.netbsd.org/docs/guide/en/chap-fetch.html
>
> i understand that "cvs" is the preferred mechanism for version control for 
> netbsd, but do you provide a "git" interface too?
>

Re: Postfix and local mail delivery - still relevant in 2020?

[matthew sporleder]

On Sat, Jun 6, 2020 at 6:31 PM Sad Clouds  wrote:
>
> On Sat, 06 Jun 2020 14:55:54 -0700
> "Greg A. Woods"  wrote:
>
> > I would suggest it is still very relevant to have a network capable
> > MTA in the base system distribution, and for that purpose Postfix is
> > a most excellent choice.
>
> What are the use-cases for it? Is it only for emailing occasional
> reports to sysadmins?

postfix is relatively small, needs very little config, and gets the
job done.  It just happens to also work at scale.
I would prefer (postfix can probably run like this but I haven't
tried) something that can exist either as a simple cron or as a
named-pipe so it can run without any running daemon to handle flushing
the local mail queue to local users or my remote aliases.

Now bind9 on the other hand... ;)

Re: pkgin error (possible workaround)

[matthew sporleder]

Thanks for the report.

On Thu, May 21, 2020 at 12:38 PM Greg Troxel  wrote:
>
> Lars-Johan Liman  writes:
>
> > I've found that the x86_64 and amd64 directories seem to be out of sync
> > on cdn.netbsd.org. In short, pkg_summary seems to be updated in x86_64
> > but not in amd64. For me the following simple workaround worked:
>
> Thanks for the specific report.
>
> > I modified the repository pointer in
> >
> > /usr/pkg/etc/pkgin/repositories.conf
> >
> > from:
> >
> > http://cdn.netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/9.0/All
> >
> > to:
> >
> > http://cdn.netbsd.org/pub/pkgsrc/packages/NetBSD/x86_64/9.0/All
>
> amd64 is the name of the port, which is about specific hardware aas well
> as the instruction set, and packages are generally shared among all
> ports with the same instruction set and ABI.   So arguably x86_64 is
> preferred anyway -- even if x86_64 appears only on the amd64 port!
>
> For your info, on ftp.netbsd.org, in /pub/pkgsrc/packages/NetBSD, doing
> ls -l (and skipping the other lines) one gets:
>
>   lrwxrwxr-x   1 joerg netbsd 6 May 28  2008 amd64 -> x86_64
>   drwxrwxr-x  16 pkgmastr  netbsd  1024 May 15 02:57 x86_64
>
> I can confirm the bad behavior.  Fetching
>
>wget 
> http://cdn.netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/9.0/All/pkg_summary.bz2
>wget 
> http://cdn.netbsd.org/pub/pkgsrc/packages/NetBSD/x86_64/9.0/All/pkg_summary.bz2
>
> I get the following: (.1 is 2nd fetch):
>
>   -rw-r--r--  1 gdt  users3270343 May 17 16:03 pkg_summary.bz2
>   -rw-r--r--  1 gdt  users3258465 May 21 10:54 pkg_summary.bz2.1

Re: Python flask app behind bozohttpd vs separate webserver for app

[matthew sporleder]

On Sat, May 16, 2020 at 11:30 PM Mayuresh  wrote:
>
> On Sat, May 16, 2020 at 03:56:47PM -0400, matthew sporleder wrote:
> > Just use apache :)  bozo has no proxy capabilities.
>
> I can invoke a Flask service from a cgi script using wget/curl - no?
> (Haven't yet tried.)
>
> Apache looks a monster to me and I don't need majority of what it offers.
>
> Mayuresh

FWIW I wrote the initial version of this:
https://cwiki.apache.org/confluence/display/HTTPD/Minimal+Config  and
at my job will run zero config apache on docker with just appending
-c's to the CMD..

With mpm_event, the minimal config, and whatever you need
(mod_proxy_uwsgi etc) you can live, easily, inside of a few MB and run
high performance.

Re: pkgin error

[matthew sporleder]

On Sat, May 16, 2020 at 8:42 AM Martin Neitzel
 wrote:
>
> ill> Same here.
> ill>
> ill> $ echo "select file_size from remote_pkg where pkgname like
> ill> 'xmlcatmgr%'" | sqlite3 pkgin.db
> ill> 25004
> ill>
> ill> $ ftp
> ill> 
> https://cdn.netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/8.0/All/xmlcatmgr-2.2nb1.tgz
> ill> 24864 bytes retrieved in 00:00 (16.63 MiB/s)
>
> Some observations on this:
>
> % echo 0 1 2 | xargs -n1 -I XX lynx -head -dump 
> http://cdn.netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/8.XX/All/xmlcatmgr-2.2nb1.tgz
>  | grep Length
> Content-Length: 24864
> Content-Length: 24864
> Content-Length: 25004
>
> This actually figures with my(!, see below) long "select" info:
>
> sqlite> select *  from remote_pkg where pkgname like 'xmlcat%' ;
>   PKG_ID = 21533
>  FULLPKGNAME = xmlcatmgr-2.2nb1
>  PKGNAME = xmlcatmgr
>  PKGVERS = 2.2nb1
>   BUILD_DATE = 2020-03-28 20:22:48 +
>  COMMENT = XML and SGML catalog manager
>  LICENSE = modified-bsd
> PKGTOOLS_VERSION = 20091115
> HOMEPAGE = http://xmlcatmgr.sourceforge.net/
>   OS_VERSION = 8.0
>  DESCRIPTION =
>  PKGPATH = textproc/xmlcatmgr
>  PKG_OPTIONS =
>   CATEGORIES = textproc
> SIZE_PKG = 50583
>FILE_SIZE = 25004
>OPSYS = NetBSD
>   REPOSITORY = 
> http://cdn.Netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/8.2/All
>
>
> Looks like Roland is rather using the 8.0 repo?
>
> I essentially noticed the same problem here, too, after...
>
> - an update on the netbsd-8 branch on May 2nd and
> - moving my /usr/pkg/etc/pkgin/repositories.conf
>   from http://cdn.NetBSD.org/pub/pkgsrc/packages/NetBSD/amd64/8.1/All
>   to   http://cdn.Netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/8.2/All
> - having nothing at all happen on "pkgin update" until
>   May 11 00:52 /var/db/pkgin/pkgin.db
>
> For "pkgin upgrade", this resulted in:
>
> 31 packages to refresh:  (xmlcatmgr-2.2nb1 ... ... ...)
> 19 packages to upgrade:
> 2 packages to install:  heimdal-1.5.3nb24 openssl-1.1.1e
>
> (I was mostly surprised about the "refresh" section.  Where does this
> come from, what is this supposed to mean?)
>
> Since I'm referring to 8.2 pkg repository, details differ for me,
> I guess I am seeing the same problem but maybe from the other side.
>
> I can still confirm the problem / the error message seen from
> my side, albeit with other packages.
>
> I get the error message with:
> download error: p5-Authen-SASL-2.16nb7 size does not match pkg_summary
>
> and [abridged]:
>
> sqlite> select *  from remote_pkg where pkgname like 'p5-Authen-SASL' ;
>   PKG_ID = 6173
>  FULLPKGNAME = p5-Authen-SASL-2.16nb7
>   BUILD_DATE = 2020-04-01 03:57:23 +
>   OS_VERSION = 8.0
> SIZE_PKG = 119267
>FILE_SIZE = 24892
>   REPOSITORY = 
> http://cdn.Netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/8.2/All
>
> % echo 0 1 2 | xargs -n1 -I XX lynx -head -dump 
> http://cdn.netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/8.XX/All/p5-Authen-SASL-2.16nb7.tgz
>  | grep Length
> Content-Length: 24900
> Content-Length: 24892
> Content-Length: 24900
>
> D'oh!
>
>
> This is not the first time this madness happens.  The last time was around
> last summer and some kind fellow on the ircnet #netbsd pointed out to me
> that the URLs
>
> http://cdn.Netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/...
> http://cdn.netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/...
>^
>|
>
> yielded different data.  Both hostnames resolved to the same IP addresses
> (as they should) but the Fastly CDN servers were apparently treating the
> requests in different ways depending on the case in the Host: headers.
>
> Martin Neitzel

I fixed the host header thing when that was pointed out.

Anyway try it now.

Re: Changes to PERL

[matthew sporleder]

> On Apr 13, 2020, at 5:11 PM, Todd Gruhn  wrote:
> 
> Where is a good place to look for current PERL syntax and examples?
> (been about 10yrs).
> 
> Which books should be updated first?
> (I have 4 of the O'Reilly PERL books)


http://modernperlbooks.com/books/modern_perl_2016/index.html

https://mojolicious.org/perldoc

CPAN is now metacpan 

Use perlcritic and perltidy 

Re: Hundreds of crypto file descriptors for Apache httpd

[matthew sporleder]

On Tue, Mar 10, 2020 at 10:59 AM Michael van Elst  wrote:
>
> fr...@phoenix.owl.de (Frank Wille) writes:
>
> >> Something is using /dev/crypto. openssl would do that, but only if
> >> you configure it.
>
> >Yes, our web-server is also listening on port 443 for several virtual hosts,
> >so SSL is configured.
>
> It's not just SSL. openssl has its own crypto routines and you would only
> use /dev/crypto when you want to use some accelerator hardware that can only
> be accessed by a kernel driver.
>
> The problem here seems to be that the devcrypto engine is builtin and openssl
> just loads every builtin engine with no knob to control that behaviour.
>
> I think the only option you have now is to prevent access to /dev/crypto.
>


https://httpd.apache.org/docs/current/mod/mod_ssl.html#sslcryptodevice
 could potentially override the use of that engine (if I'm
understanding things correctly).

The 200+ FDs might be one per apache child (if running prefork)?

Re: Alternative DVCS to git: hg?

[matthew sporleder]

On Fri, Apr 19, 2019 at 2:07 AM Sad Clouds  wrote:
>
> On Thu, 18 Apr 2019 12:29:32 -0400
> Andrew Cagney  wrote:
>
> > When two fully tested commits hit the repo at the same time, and the
> > result is broken, who do I blame? Subversion?  We can hardly wave a
> > finger at the developer who had the simple misfortune of being second
> > with their push?
>
> This alleged design flaw in Subversion, is it something that you can
> actually reproduce or are you just repeating something that you heard
> from someone somewhere? You seem to be the only person to come across
> the issue. Many people use Subversion concurrently and they don't
> seem to be reporting such problems. So if the issue does exist, as
> you claim, can you please give us a demonstration and show us exactly
> how and when your files get corrupted?
>

What's all this talk about ACID and conflicts when all of them still
suffer from 3-way-merge bugs anyway? ;)

https://tahoe-lafs.org/~zooko/badmerge/concrete-good-semantics.html

Re: concurrencykit in the kernel!

[matthew sporleder]

On Fri, Apr 12, 2019 at 8:05 AM Mayuresh Kathe  wrote:
>
> heard about freebsd guys using the concurrency kit (concurrencykit.org)
> in their kernel. anyone has any idea about how it could be useful from
> a netbsd perspective too? i was under the impression that the kit would
> be useful only for userland projects, wonder what role it would play at
> the kernel level.

Hey I added that pkg!  I think anywhere we have similar algorithms it
would be useful to, at least, compare the concurrencykit
implementation if not use it.

I'm sure the kernel and userland both do tons of this stuff:
http://concurrencykit.org/man.html

Re: Can not Download NetBSD 8.0 i386 USB Install Image

[matthew sporleder]

Okay fastly support has reported that the issue was related to the
beta.  Basically if a file changes but the name does not we *MUST*
PURGE that file or this can happen (parts of the files are cache-HIT
and other parts are cache-MISS, so mixing them up won't work if the
file has changed half-way).

I will try to figure out how to get the build system to do the right thing.


On Mon, Feb 4, 2019 at 1:30 PM matthew sporleder  wrote:
>
> On Mon, Feb 4, 2019 at 1:23 PM Andrei M.  wrote:
> >
> > чт, 31 янв. 2019 г. в 18:14, JingYuan Chen :
> > >
> > > AhhI forgot to describe more detail about my problem.
> > > I used Firefox to download i386 USB install image form NetBSD's download 
> > > page.
> > >
> > > The URL is as follows :
> > > https://cdn.netbsd.org/pub/NetBSD/NetBSD-8.0/images/NetBSD-8.0-i386-install.img.gz
> > >
> > > After clicking the link, firefox shows that the source file can not be
> > > read. So that I try to download
> > >  i386 ISO image. But the error message is the same.
> > >
> > > There may be something wrong with amd64 ISO image. I had downloaded
> > > amd64 ISO image last Sunday.
> > > But I can not download it now. Firefox responds File not found. :(
> > >
> > > Is there something wrong with cdn.netbsd.org ???
> > >
> >
> > Has been happening to me today too.
> > I've tried to download the following file 5 or 6 times:
> > http://nycdn.netbsd.org/pub/NetBSD-daily/netbsd-8/latest/images/NetBSD-8.0_STABLE-amd64-install.img.gz
> >
> > When download is 99,99% completed, it says 'Download failed' and
> > cannot be resumed. Experienced in Firefox and Chrome, Ubuntu 64bit
> > versions.
> >
> > Andrei
>
> Hi everyone.  A little while ago fastly asked if we could be test
> subjects for a new feature and this is *very likely* fallout from
> that.
>
> I will raise an issue with them and send this thread.

Re: Can not Download NetBSD 8.0 i386 USB Install Image

[matthew sporleder]

On Mon, Feb 4, 2019 at 1:23 PM Andrei M.  wrote:
>
> чт, 31 янв. 2019 г. в 18:14, JingYuan Chen :
> >
> > AhhI forgot to describe more detail about my problem.
> > I used Firefox to download i386 USB install image form NetBSD's download 
> > page.
> >
> > The URL is as follows :
> > https://cdn.netbsd.org/pub/NetBSD/NetBSD-8.0/images/NetBSD-8.0-i386-install.img.gz
> >
> > After clicking the link, firefox shows that the source file can not be
> > read. So that I try to download
> >  i386 ISO image. But the error message is the same.
> >
> > There may be something wrong with amd64 ISO image. I had downloaded
> > amd64 ISO image last Sunday.
> > But I can not download it now. Firefox responds File not found. :(
> >
> > Is there something wrong with cdn.netbsd.org ???
> >
>
> Has been happening to me today too.
> I've tried to download the following file 5 or 6 times:
> http://nycdn.netbsd.org/pub/NetBSD-daily/netbsd-8/latest/images/NetBSD-8.0_STABLE-amd64-install.img.gz
>
> When download is 99,99% completed, it says 'Download failed' and
> cannot be resumed. Experienced in Firefox and Chrome, Ubuntu 64bit
> versions.
>
> Andrei

Hi everyone.  A little while ago fastly asked if we could be test
subjects for a new feature and this is *very likely* fallout from
that.

I will raise an issue with them and send this thread.

Re: choosing a lightweight database

[matthew sporleder]

On Wed, Jan 16, 2019 at 1:12 PM Greg Troxel  wrote:
>
> John Nemeth  writes:
>
> > } If it turns out your data size or query/update rate is too much, I would
> > } use postgres.  I know you said you don't want a process, but unlike
> > } mysql postgres is really easy to set up.
> >
> >  It would be nice to get rid of some of the FUD around here.
> > MySQL is quite simple to setup, especially if you're installing it
> > from pkgsrc.  mysql-cluster is complex to setup, but that is for
> > master-master replication with redundancy.  The regular mysql-server
> > is just pkgin mysql-server, set the "root" password and you're off
> > to the races.
>
> That wasn't my experience.  WIth pgsql, I was able to just 'createuser'
> the username matching the one the daemon that wants to use it.  With
> mysql, there was a bunch of stuff about creating username/password pairs
> and for a particular db-using application, it was a lot more work to get
> things to actually run correctly.   My memory, which could be off, is
> that I also had to configure it not to listen beyond localhost.
>
> But, the pkgsrc package was indeed first class, and things were only
> annoying at the 30-minute level.

As a long time mysql user I had the exact difficulty you describe
trying to grok postgres when I could be up-and-running with mysql
inside of a minute.

Funny how that all works, isn't it?

Re: pkgin

[matthew sporleder]

On Thu, Oct 18, 2018 at 3:24 AM Pedro Pinho  wrote:
>
> Hi all,
> I'm rather new to NetBSD, been using it on a laptop for about 3 months now, 
> amd64 8.0. I'm really enjoying this OS and everything is working fine. So, 
> sorry if this has already been answered...
>
> Why does http://pkgin.net/ points to https://github.com/NetBSDfr/pkgin ?
> This github repo has not seen any commit for the last two years.
> Wouldn't be better if it would point to https://github.com/joyent/pkgin , 
> just like pkgsrc.se does?
> Is there a reason for it?
>
> Thanks!

I'm guessing it has something to do with the text you can find here:
https://github.com/iMilnb  :)

Anyway good suggestion.

Re: git https issue

[matthew sporleder]

On Sun, Aug 19, 2018 at 4:26 AM, Riccardo Mottola
 wrote:
> Hi,
>
>
> On 19/08/2018 02:26, Matt Sporleder wrote:
>>
>>
>> Can you do curl -vvv to GitHub?
>
>
> hmm, if you mean just to the homepage like below, we have an issue :(
>
> narsil$ curl -vvv https://github.com/
> *   Trying 192.30.253.113...
> * TCP_NODELAY set
> * Connected to github.com (192.30.253.113) port 443 (#0)
> * ALPN, offering http/1.1
> * Cipher selection:
> ALL:!EXPORT:!EXPORT40:!EXPORT56:!aNULL:!LOW:!RC4:@STRENGTH
> * successfully set certificate verify locations:
>   CAfile: none
>   CApath: /etc/openssl/certs
> * TLSv1.2 (OUT), TLS header, Certificate Status (22):
> * TLSv1.2 (OUT), TLS handshake, Client hello (1):
> * TLSv1.2 (IN), TLS handshake, Server hello (2):
> * TLSv1.2 (IN), TLS handshake, Certificate (11):
> * TLSv1.2 (IN), TLS handshake, Server key exchange (12):
> * TLSv1.2 (IN), TLS handshake, Server finished (14):
> * TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
> * TLSv1.2 (OUT), TLS change cipher, Client hello (1):
> [1]   Illegal instruction (core dumped) curl -vvv https://github.com/
>
> gdb tells me:
> * TLSv1.2 (OUT), TLS change cipher, Client hello (1):
>
> Thread 1 received signal SIGILL, Illegal instruction.
> 0xb66f3d50 in gcm_ghash_4bit_mmx () from /usr/lib/libcrypto.so.12
>
>
> (gdb) bt
> #0  0xb66f3d50 in gcm_ghash_4bit_mmx () from /usr/lib/libcrypto.so.12
> #1  0x in ?? ()
>
> very nice :)
>
> now I don't remember if this CPU has MMX or not...
> cpu0 at mainbus0
> cpu0: Intel 586-class, 232MHz, id 0x581
> cpu0: package 0, core 0, smt 0
>
> It should though, according to: https://www.thinkwiki.org/wiki/Category:600
>
>
> Riccardo

Looks like you found the issue.

Re: git https issue

[matthew sporleder]

On Fri, Aug 10, 2018 at 6:01 PM, Riccardo Mottola
 wrote:
> Hi Matthew,
>
>
> On 05/08/2018 19:44, matthew sporleder wrote:
>>
>> On Sun, Aug 5, 2018 at 7:57 AM, Riccardo Mottola
>>  wrote:
>>>
>>> Hi Matthew,
>>>
>>>
>>> On 30/07/2018 22:18, matthew sporleder wrote:
>>>>
>>>> Does it hang or finish?  GIT_CURL_VERBOSE or --verbose ?
>>>
>>>
>>> it finishes without doing anything, I added --verbose:
>>>
>>> $ git clone --verbose https://github.com/github/debug-repo
>>> /tmp/debug-repo-http
>>> Cloning into '/tmp/debug-repo-http'...
>>> $
>>>
>>> no output... the variable helps though:
>>>
>>> narsil$ git clone --verbose https://github.com/github/debug-repo
>>> /tmp/debug-repo-http
>>> Cloning into '/tmp/debug-repo-http'...
>>> * Couldn't find host github.com in the .netrc file; using defaults
>>> *   Trying 192.30.253.113...
>>> * TCP_NODELAY set
>>> * Connected to github.com (192.30.253.113) port 443 (#0)
>>> * ALPN, offering http/1.1
>>> * Cipher selection:
>>> ALL:!EXPORT:!EXPORT40:!EXPORT56:!aNULL:!LOW:!RC4:@STRENGTH
>>> * successfully set certificate verify locations:
>>>CAfile: none
>>>CApath: /etc/openssl/certs
>>>
>>>
>>> where is the issue?? a missing cert? can I force reinstalling
>>> certificates?
>>>
>>> Riccardo
>>>
>>>
>>
>>
>> When I do it:
>> tmp $ GIT_CURL_VERBOSE=1 git clone --verbose
>> https://github.com/github/debug-repo
>> Cloning into 'debug-repo'...
>> * Couldn't find host github.com in the .netrc file; using defaults
>> *   Trying 192.30.253.112...
>> * TCP_NODELAY set
>> * Connected to github.com (192.30.253.112) port 443 (#0)
>> * Cipher selection:
>> ALL:!EXPORT:!EXPORT40:!EXPORT56:!aNULL:!LOW:!RC4:@STRENGTH
>> * successfully set certificate verify locations:
>> *   CAfile: none
>>CApath: /etc/openssl/certs
>> * SSL connection using TLSv1.2 / ECDHE-RSA-AES128-GCM-SHA256
>> * Server certificate:
>> *  subject: businessCategory=Private Organization;
>> 1.3.6.1.4.1.311.60.2.1.3=US; 1.3.6.1.4.1.311.60.2.1.2=Delaware;
>> serialNumber=5157550; C=US; ST=California; L=San Francisco; O=GitHub,
>> Inc.; CN=github.com
>> *  start date: May  8 00:00:00 2018 GMT
>> *  expire date: Jun  3 12:00:00 2020 GMT
>> *  subjectAltName: host "github.com" matched cert's "github.com"
>> *  issuer: C=US; O=DigiCert Inc; OU=www.digicert.com; CN=DigiCert SHA2
>> Extended Validation Server CA
>> *  SSL certificate verify ok.
>>>
>>> GET /github/debug-repo/info/refs?service=git-upload-pack HTTP/1.1
>>
>> Host: github.com
>> User-Agent: git/2.14.1
>> Accept: */*
>> Accept-Encoding: gzip
>> Accept-Language: en-US, *;q=0.9
>> Pragma: no-cache
>>
>> < HTTP/1.1 200 OK
>> < Server: GitHub Babel 2.0
>> < Content-Type: application/x-git-upload-pack-advertisement
>> < Transfer-Encoding: chunked
>> < Expires: Fri, 01 Jan 1980 00:00:00 GMT
>> < Pragma: no-cache
>> < Cache-Control: no-cache, max-age=0, must-revalidate
>> < Vary: Accept-Encoding
>> < X-GitHub-Request-Id: C495:6D8D:17611E4:288C91B:5B673724
>> < X-Frame-Options: DENY
>> <
>> * Connection #0 to host github.com left intact
>> POST git-upload-pack (165 bytes)
>> * Couldn't find host github.com in the .netrc file; using defaults
>> * Found bundle for host github.com: 0x7f7ff7b2e200 [can pipeline]
>> * Re-using existing connection! (#0) with host github.com
>> * Connected to github.com (192.30.253.112) port 443 (#0)
>>>
>>> POST /github/debug-repo/git-upload-pack HTTP/1.1
>>
>> Host: github.com
>> User-Agent: git/2.14.1
>> Accept-Encoding: gzip
>> Content-Type: application/x-git-upload-pack-request
>> Accept: application/x-git-upload-pack-result
>> Content-Length: 165
>>
>> * upload completely sent off: 165 out of 165 bytes
>> < HTTP/1.1 200 OK
>> < Server: GitHub Babel 2.0
>> < Content-Type: application/x-git-upload-pack-result
>> < Transfer-Encoding: chunked
>>
>>
>
> indeed, quite a different output, but where is the issue? I do wonder?
>
> Just to be sure, I installed
> http://ftp.netbsd.org/pub/pkgsrc/packages/NetBSD/i386/8.0_2018Q1/All/mozilla-rootcerts-openssl-2.1.tgz
> so I have fresh certificates (the old one remained in /etc/openssl/certs
> after upgrade)
>
> but it did not help. What else could I missing? I bet it is a configuration
> issue
>
> Thank you
>
> Riccardo

I think the GIT_CURL_VERBOSE=1 is going to give you the answer.

Re: git https issue

[matthew sporleder]

On Mon, Jul 30, 2018 at 4:13 PM, Riccardo Mottola
 wrote:
> Hi All,
>
> I have some strange happening after I upgraded to 8.0 with 8.0_2018Q1
> packages (I removed  all packages before and reinstalled)
>
> I cannot git clone or git pull over https anymore!
> Even existing repositories do not pull! And I see no errors, like:
>
> $ git clone https://github.com/github/debug-repo /tmp/debug-repo-http
> Cloning into '/tmp/debug-repo-http'...
>
> and "nothing" happens and no repository.
> How can I debug more??
>
> However if I use ssh it works!
>
> $ git clone g...@github.com:github/debug-repo /tmp/debug-repo-ssh
> Cloning into '/tmp/debug-repo-ssh'...
> The authenticity of host 'github.com (192.30.253.112)' can't be established.
> RSA key fingerprint is SHA256:nThbg6kXUpJWGl7E1IGOCspRomTxdCARLviKw6E5SY8.
> Are you sure you want to continue connecting (yes/no)? yes
> Warning: Permanently added 'github.com,192.30.253.112' (RSA) to the list of
> known hosts.
> remote: Counting objects: 1649, done.
> remote: Total 1649 (delta 0), reused 0 (delta 0), pack-reused 1649
> Receiving objects: 100% (1649/1649), 324.17 KiB | 246.00 KiB/s, done.
> Resolving deltas: 100% (1063/1063), done.
>
> why? What changed? configurations should have remained the same, since I
> upgraded. mozilla certificates are installed.
>
> Riccardo
>


Does it hang or finish?  GIT_CURL_VERBOSE or --verbose ?

Re: Some Updates from man-k.org

[matthew sporleder]

nice

On Sun, Oct 15, 2017 at 2:30 AM, Abhinav Upadhyay
 wrote:
> Hi,
>
> A couple of small updates from man-k.org which I did recently:
>
> The man pages now contain anchor tags for individual sections and
> subsections in the man page. For example
> http://man-k.org/man/NetBSD-current/1/awk#EXAMPLES. This was a new
> feature that came out with mandoc-1.14.2.
>
> Many people asked for a way to directly access a man page without
> having to go through the search. So I've added direct URLs, which is
> inspired from how mdoc.su does it. You can directly use URLs of the
> following form to directly access man pages:
>
> http://man-k.org/n/ls(1) --> ls(1) for NetBSD-current
> http://man-k.org/f/ls(1) --> ls(1) for FreeBSD-current
> http://man-k.org/o/ls(1) --> ls(1) for OpenBSD
>
> --
> Abhinav

Fwd: nyftp.netbsd.org outage 2017-07-24 through 2017-07-25

[matthew sporleder]

In case anyone was wondering why the various ny* servers are down right now..


-- Forwarded message --
From: Thor Lancelot Simon 
Date: Mon, Jul 24, 2017 at 1:38 AM
Subject: nyftp.netbsd.org outage 2017-07-24 through 2017-07-25


Due to urgent construction, nyftp.netbsd.org and other NetBSD resources
hosted at Columbia University will be offline beginning mid-day (New York
time) today, the 24th of July, and will come back online some time late in
the day tomorrow, the 25th.

Re: NetBSD on a Soekris net4801

[matthew sporleder]

On Fri, Feb 10, 2017 at 2:26 PM,   wrote:
> Hi all,
> I'm thinking of running NetBSD on a Soekris net4801. It has 128 MB RAM and 1 
> GB CF card.
> Does anybody have experience running NetBSD on these machines? Do I need a 
> custom kernel for the AMD Geode CPU on the machines?
> Is there a good way to reduce wear (for example swap use) to increase the CF 
> card's life?
> Thanks,
> udon


I wrote this while running netbsd on my net4801 to save the CF card:
http://mspo.com/how-to/netbsdreadmostly.html
and also this for netbooting, etc:
http://www.mspo.com/how-to/soekris.html

Re: The old wiki.netbsd.se

[matthew sporleder]

On Fri, Dec 2, 2016 at 1:48 PM, Swift Griggs  wrote:
>
>
> https://web.archive.org/web/20100527034652/http://wiki.netbsd.se/Main_Page
>
> "Dear Users, Thank you for your patience and your contributions over the
> last 4 years. The time has come to shut down this wiki. Please refer to the
> official NetBSD wiki in the future."
>
> I'm just being nosy. Anyone remember what happened that made the site
> operator ditch the site? "The time has come" Why did it come ?
>
> Personally, I found it far more useful and rewarding than the TNF wiki (not
> knocking TNF). Plus, I had an account and could edit pages etc..
>
> I'm considering snarfing all my content back outta the wayback machine and
> resurrecting my own version of it. However, I'd first like to understand the
> original story if anyone knows it. Was it hackers beating on the site?
> Spammers take over the mail relay? Did the guy just get a divorce and his
> ex-wife's alimony take away the bandwidth fees?
>
> The answer I'd dread to hear is "It was too open and not dryly clinical or
> academically pedantic enough. So, we shut it down. Too many people had
> access." Unfortunately, due to the meta-refresh to wiki.netbsd.org appearing
> right afterward, it's an open question in my mind. Thus, I don't want to end
> up fussing with TNF if I stood something like it back up. That's the main
> reason why I'm so curious.
>
> Please don't take my speculation the wrong way, it's just guessing/fear.
>
> Maybe I was the only one who liked it and I'm just wasting my time.
>
> Thanks,
>   Swift


I imported things I thought were useful into wiki.netbsd.org, mostly
here: http://wiki.netbsd.org/tutorials/

Re: bozohttpd support for SNI

[matthew sporleder]

On Fri, Sep 30, 2016 at 4:43 PM, Alistair Crooks  wrote:

> Personally, I'd love to have support for SNI (and multiple -Z paths
> per site too) - I'd use it daily.
>
> In fact, I was just bemoaning that fact yesterday, but am not
> best-placed to do anything about it right now (yes, I suck :()
>
> Best,
> Alistair
>
> On 30 September 2016 at 13:37, J. Lewis Muir  wrote:
> > Hello!
> >
> > Does bozohttpd in NetBSD (7 or current) support SNI (Server Name
> > Identification) such that multiple SSL sites can be served from one
> > HTTPS server?  If not, what is NetBSD's position on the feature: is it
> > "we're open to accepting a quality patch," or is it more "we'd rather
> > not add the feature; it's better to just use separate server instances
> > on separate IP addresses; we're trying to keep with bozohttpd's main
> > feature as stated on its website which is 'the lack of features,
> > reducing the code size and improving verifiability'"?
> >
> > Thanks!
> >
> > Lewis
> >
>

bozo is growing features pretty quickly as netbsd keeps trying to use it to
do actual stuff(tm).  :)

Re: System fails to start dhclient at boot after upgrade 6.1.5 -> 7.0.1

[matthew sporleder]

On Wed, Jul 6, 2016 at 9:05 AM,   wrote:
> I have just upgraded my server from 6.1.5 to 7.0.1 and I'm having
> trouble with dhclient.  My expectation is that the rc system will launch
> dhclient early in the boot process and wait for it to finish before
> moving on.  This does not happen.  Instead it rushes right into
> launching daemons (which fills my logs with named complaints).
> Sometimes it will complete acquisition after boot, but half the time it
> fails completely and a "/etc/rc.d/dhclient restart" says that the
> service is already stopped.  This is a headless server so watching the
> console is difficult.  It has two interfaces, with only the external
> using dhclient.  The working rc.conf was not changed during the 7.0.1
> upgrade.
>
> A quick look over the NetBSD-7 and 7.0.1 release notices doesn't show me
> any obvious reason for a change in behavior.  Does anyone know what is
> going on?
>
> thanks,
> -d


Can you run rcorder and find out what rc might be doing?

rcorder -s nostart /etc/rc.d

also check for things that might have snuck into /etc/rc.conf.d

Re: https://nxr.netbsd.org/ memory errors?

[matthew sporleder]

On Sat, Jun 18, 2016 at 10:24 AM, Constantine A. Murenin
 wrote:
> On 17 June 2016 at 16:50,   wrote:
>> When searching, I'm gettings errors on that site such as:
>>
>>   There was an error!
>>
>>   java.lang.OutOfMemoryError: Java heap space
>>
>>   Java heap space
>>
>> Can someone investigate?
>>
>> Just out of curiosity, what other sites for code web-browsing do people
>> like?  For FreeBSD, I like to use http://fxr.watson.org/ now, but I'm
>> not sure if its NetBSD section is up to date anymore.
>>
>> Thanks
>
> Have you tried BXR.SU?
>
> http://BXR.SU/NetBSD/
>
> I still run it on a memory filesystem, so, a NetBSD search would only
> take 20ms, vs. 200--600ms+ on other OpenGrok-based sites.
>
> C.

Adding Zafer to the thread, since he runs the system.  It probably
just needs a bounce.

Re: Rumpkernel comments by Linus

[matthew sporleder]

He hasn't looked at it so I don't think he's giving a real critique.
As far as I can tell he's talking about things like NDISwrapper or
softmodem and fails to grasp what rump is about.

On Wed, Apr 27, 2016 at 2:40 PM, Swift Griggs  wrote:
>
> Linus seems to frown on the rumpkernel efforts since he believes it'll put
> the OS into a straight jacket (my words, not his). The original post is
> below. However, what say you folks? Is he reacting to something he doesn't
> know anything about based on his general instincts or is he making a
> legitimate critique? Is it a value-system judgment or is he missing some
> fact about the AnyKernel approach that negates his preconceptions? Is it
> simply a case that Linux already gets lots of DriverLove[tm] from the
> vendors and they just don't have to care or is that too cynical?
>
> -Swift
>
>
> ---[ Slashdot Snippet ]---
> https://linux.slashdot.org/story/15/06/30/0058243/interviews-linus-torvalds-answers-your-question
>
> "anykernel"-style portable drivers?
> by staalmannen
>
> What do you think about the "anykernel" concept (invented by another Finn
> btw) used in NetBSD? Basically, they have modularized the code so that a
> driver can be built either in a monolithic kernel or for user space
> without source code changes ( rumpkernel.org ). The drivers are highly
> portable and used in Genode os (L4 type kernels), minix etc... Would this
> be possible or desirable for Linux? Apparently there is one attempt called
> "libos"...
>
> Linus: So I have bad experiences with "portable" drivers. Writing drivers
> to some common environment tends to force some ridiculously nasty
> impedance matching abstractions that just get in the way and make things
> really hard to read and modify. It gets particularly nasty when everybody
> ends up having complicated - and differently so - driver subsystems to
> handle a lot of commonalities for a certain class of drivers (say a
> network driver, or a USB driver), and the different operating systems
> really have very different approaches and locking rules etc.
>
> I haven't seen anykernel drivers, but from past experience my reaction to
> "portable device drivers" is to run away, screaming like little girl. As
> they say in Swedish "Brnt barn luktar illa".
>

Re: non-ASCII support?

[matthew sporleder]

On Tue, Feb 23, 2016 at 3:46 PM, Malcolm Herbert  wrote:
> Folks - I use a combination of bash, screen, irssi (all on NetBSD) at
> the remote end and putty (on Windows) or Terminal (on Ubuntu) at the
> local end and haven't been able to get utf-8 working end-to-end ...
>
> Are there tips or pointers on getting more-than-merely-ASCII working
> with this combination? Are there testing tools I can use to work out
> which bit might be dropping the ball?
>
> Given the world-wide nature of development on NetBSD, I don't believe
> it isn't supported, I'm very probably just not doing it right ... :)
>
> Regards,
> Malcolm
>
> --
> Malcolm Herbert
> m...@mjch.net


I recently got all of this working thanks to:
http://docs.perl6.org/language/unicode_entry

and settings in my terminal (osx)
advanced -> text encoding -> utf-8
my lang:
~ $ echo $LANG
en_US.UTF-8

(that's local and remote after ssh)


in screenrc:
defutf8 on
utf8 on

/SET term_charset utf-8 in irssi

start screen with -U

and now I can finally use perl6 characters in irc. «like this»

Re: History behind pkgsrc 'biology' category

[matthew sporleder]

On Fri, Feb 5, 2016 at 6:09 PM, Swift Griggs  wrote:
>
> I am curious (only curious - this is not a complaint): Does anyone know why
> there ended up being a pretty well-fleshed-out 'biology' section in pkgsrc
> but there isn't "chemistry", "physics", "engineering" etc...
>
> Was there some prodigious pkgsrc maintainer/hacker who was a biologist or is
> it just that there happen to be more biology-related programs which justify
> the discrete category?
>
> Again, not complaining. I think it's quirky and cool. I'm just curious.
>
> Thanks,
>   Swift


I wasn't around then but the cvs history pretty much confirms my suspicions:

René Hexel  (rh@)  started the category in 1999 with the message:
"Enable bioperl."

If you recall, the late 90's and early 2000's saw a big push in
bioinformatics, and especially with perl as a processing language.

Matt

p.s. I have cc'ed René to see if more details can be shared.

Re: filesystem change monitoring

[matthew sporleder]

On Thu, Aug 13, 2015 at 5:51 AM, Emmanuel Dreyfus m...@netbsd.org wrote:
 On Tue, Aug 11, 2015 at 02:44:10PM +, Emmanuel Dreyfus wrote:
 Do we have a smart way to monitor a whole filesystem hierarchy for
 changes?

 Replying to myself: the short answer is no. kqueue will not scale to
 thousands of nodes because it needs to open a filedescriptor for each.

 lsyncd has been mentionned in the thread. On NetBSD, it uses kqueue
 and therefore suffers the sclaing limitation.

 An ongoing project to fix kqueue was mentionned:
 https://wiki.netbsd.org/projects/project/kqueue-dirnotify/

 That situation begs for an interm solution. Since my problem is to mirror
 a file hierarchy from an host to another, I crafter an utility called
 fsssyncd as an attempt to address the problem without lenghlty kernel
 hacking (that will be necessary, but not this week!):
 http://ftp.espci.fr/pub/syncffsd/syncffsd-0.1.tgz

 Basic usage:
 syncfssd /usr/local/source host:/usr/local/destination

 From the man page:
 syncfssd uses rsync(1) to replicate a directory tree to another host.
 This involves detecting changes, something NetBSD is not well prepared to
 handle. The kqueue(2) interface can detect changes, but it needs to use a
 file descriptor for every node monitored, and this does not scales very
 well for huge directories trees.

 syncfssd attempts to improve the situation until kqueue(2) gets better,
 by using FFS superblock's fs_time field, which is updated on every
 filesystem change. This lets syncfssd detects a change immediatly if the
 filesystem is mounted synchronous, or after a few seconds if mounted with
 WAPBL(4) enabled.

 Once a change is detected, the relevant nodes are found by walking source
 looking for files that changed since the previous filesystem modifica-
 tion.  The resulting nodes are deduped (i.e.: we do not retain a node in
 a directory if the directory itself changed), and are fed to rsync(1).

 This logic could be embedded into lsyncd but I am not sure such work makes
 sense. Improving kqueue seems a better, more general goal.

 Feedbacks on this version 0.1 are welcome.

 --
 Emmanuel Dreyfus
 m...@netbsd.org

Syncing dirs rsync-style is served well by unison
http://www.cis.upenn.edu/~bcpierce/unison/

Re: filesystem change monitoring

[matthew sporleder]

On Thu, Aug 13, 2015 at 3:15 PM, Emmanuel Dreyfus m...@netbsd.org wrote:
 matthew sporleder msporle...@gmail.com wrote:

 Syncing dirs rsync-style is served well by unison
 http://www.cis.upenn.edu/~bcpierce/unison/

 That does not seem to perform near-time sync, does it?


No, it's trigger manually (like with cron).

Re: filesystem change monitoring

[matthew sporleder]

On Wed, Aug 12, 2015 at 7:35 AM, Emmanuel Dreyfus m...@netbsd.org wrote:
 Ryo ONODERA ryo...@yk.rim.or.jp wrote:

 I have no idea about large hierarchy,

 Simple: try to mirror a hiearchy with more than kern.maxfiles nodes, you
 loose.

 --
 Emmanuel Dreyfus
 http://hcpnet.free.fr/pubz
 m...@netbsd.org

https://wiki.netbsd.org/projects/project/kqueue-dirnotify/

Linux has inotify, which can do a single directory and windows has a
more advanced system.

I don't know if solaris or others had yet-another interface.

using /etc/cron.d

[matthew sporleder]

I was attempting to put a cron file in /etc/cron.d today and could not
figure out how to not get this message:
(*system*) BAD FILE MODE (/etc/cron.d/github-pull)


That appears to be coming from
if ((eqmode  (statbuf-st_mode  07577) != eqmode) ||
(badmode  (statbuf-st_mode  badmode) != 0))

Isn't 07577 too many digits?

---

Also I was having trouble getting crond to pick up my changes unless I
did a touch of the /etc/cron.d directory (not just the file I was
editing);

Any ideas?

Thanks,
Matt

Re: how to protect sd card on rpi

[matthew sporleder]

On Mon, Sep 22, 2014 at 11:20 AM, Zoran Kolic zko...@sbb.rs wrote:
 After installing on raspberry pi, I found few articles,
 how to help sd card to live longer. What is neccessary
 to put in conf files for that?

 I.e. to have in fstab:

/dev/ld0a/ffs rw,noatime,nodevmtime 1 1

 Then to put into /etc/rc.conf:

   syslogd=NO
   manpagedb=NO
   savecore=NO
   virecover=NO
   fsck_flags=-P -p -y

 Also, how would apmd and powerd behave on rpi?
 Best regards

Zoran



This is probably out of date.. but:
http://mspo.com/how-to/netbsdreadmostly.html

Re: Create a file with history in sh

[matthew sporleder]

On Wed, Jun 18, 2014 at 8:51 AM, Greg Troxel g...@ir.bbn.com wrote:

 Rocky Hotas rockyho...@post.com writes:

 I am quite new with this mailing-list.

 I've redirected followups to netbsd-users.  tech-userlevel is for
 arguing about complicated bugs or proposed changes ;-)

 During the installation of NetBSD, I choose /bin/sh as the default root and 
 user shell.
 In the users' home directories there are not files like .sh_history or
 similar and no history-like files are updated when I log in or log
 out. But I would like to keep trace of all the commands typed in the
 terminal, the last 100 or 1000, and not only the ones typed in the
 current login session, accessible with the up arrow.
 Reading the sh manual I didn't find the possibility to create a permanent 
 file with history like in bash or ksh.
 Is it true or there exist some possibility to do this? Or where I can look 
 for this option?

 There's no reason you have to use /bin/sh for users.  You can install
 bash from pkgsrc, and set the user's shell to /usr/pkg/bin/bash.  Many
 people do this (or some other shell in pkgsrc).  I suggest keeping root
 as /bin/sh for avoiding problems, but best practice is to use the actual
 root account sparingly anyway.  (sudo -E will give you a uid 0 version
 of your own shell, sourcing dotfiles.)

 /bin/sh in NetBSD is intentionally minimalist:

textdata bss dec hex filename
  11622912685832  123329   1e1c1 /bin/sh

textdata bss dec hex filename
  817301   18820   12272  848393   cf209 /usr/pkg/bin/bash

 (Of course, one has to look at libraries, too, but in general our sh has
 a lot less UI complexity.)


ksh will have all of the features you want and is installed in base.

Re: Create a file with history in sh

[matthew sporleder]

On Wed, Jun 18, 2014 at 9:51 AM, Ottavio Caruso
ottavio2006-usenet2...@yahoo.com wrote:
 On 18 June 2014 15:09, matthew sporleder msporle...@gmail.com wrote:
 ksh will have all of the features you want and is installed in base.

 Interesting. I definitely need bash as a normal user but I would
 gladly use ksh as root.

 Why is this not in the docs and in INSTALL.html? That would have saved
 me some valuable time.


I thought it was an option in the installer to select the shell.  (sh,
csh, or ksh)

Obviously each could be described better.

Re: Muddled wrt pkgsrc

[matthew sporleder]

On Wed, Mar 12, 2014 at 5:46 AM, Brett Lymn bl...@internode.on.net wrote:
 On Tue, Mar 11, 2014 at 12:52:05PM +0100, Rhialto wrote:

 Do you use pkg_comp for that or did you roll your own? And if so, any
 particular thing missing from pkg_comp?


 hey guys, I have this round thing, you can put it on the bottom of stuff
 and it makes things move easier... you sort of say whee when using it so
 I called it a wheel... oh wait.

 But seriously, only my ignorance stopped me using pkg_comp.  The one I
 rolled was pretty simple and suits my needs.  The only thing I can offer
 as recompense is I do have a script that creates a meta-pkg makefile
 from a simple list of packages.  It queries the installed packages and
 writes the DEPENDS so that the meta-pkg depends on = the current
 version in pkgsrc so it forces a refresh.

 --
 Brett Lymn
 Staple Guns: because duct tape doesn't make that KerCHUNK sound - xkcd.com


http://mail-index.netbsd.org/tech-pkg/2013/05/11/msg011296.html

That patch + make replace would have done the job.

Re: CDE on NetBSD

[matthew sporleder]

On Tue, Mar 11, 2014 at 6:54 AM, Lucius Rizzo lucius.ri...@lucius.xxx wrote:
 So I happened across the latest CDE release and very pleasantly found
 NetBSD as now one of the supported platforms.

 http://sourceforge.net/p/cdesktopenv/wiki/NetBSD/

 So the ones who haven't choked on their breakfast thinking back of the
 CDE hating days, are you on this list? I am planning to try this soon and
 if there is anyone I can a) thank for actually something so awesome to be
 on NetBSD and b) actually have a working DE with CDE and can share your
 thoughts on how it runs etc.

 I 3 CDE. :)

 --

 | _o_ |_)o_ _  _
 |_|_|(_||_|_ | \|/_/_(_) - Lucius.Tel
 --
 ++ transfer, n.: ++
 ++  A promotion you receive on the condition that you leave town. ++



I remember the announcement for this and was pleased to see it
(although I'll take xfce these days).

http://pkgsrc.se/wip/cde exists.  Maybe it could use an update to
2.2.1 (currently 2.2.0).

Re: TCP/IP outbound connection routing

[matthew sporleder]

On Fri, Feb 21, 2014 at 11:31 AM, Scott Burns scott.bu...@seqent.com wrote:
 We are attempting to build a customized monitoring solution for a customer.

 The customer would like us to access his remote server over the in facility
 Wi-Fi to basically monitor both the Wi-Fi infrastructure is up and the
 server we are connecting to is working properly.

 To facilitate notification we need to have a wired lan connection on the
 same network to dispatch email etc. when a problem is detected.

 I know we can easily create a TCP/IP listener that listens only on the WiFi
 NIC interface but is there a way to make a connect() call so that this call
 is only routed over the Wi-Fi NIC connection? We can obviously play with
 Metrics and have the Wi-Fi NIC preferred but if it is down the connect call
 will take the wired NIC path since it is on the same network.

 Ie.
 Monitored Server
 ---
 Wired NIC - 200.1.1.100


 Monitoring Appliance - NetBSD/amd64
 ---
 Wi-Fi NIC - 200.1.1.1
 Wired NIC - 200.1.1.2

 I want an application on the Monitoring Appliance to connect to the
 Monitored Server (200.1.1.100) only over the Wi-Fi NIC (200.1.1.1).
 If that connection fails (Monitored Server down, Wi-Fi NIC offline, Access
 Point unplugged, switch broken etc.) I want to make a connection over the
 Wired NIC (200.1.1.2) to send email and other notification types.

 With NetBSD/amd64 6.x is there any way to force the connect() call to only
 use one interface as it's connect path much like you make the bind() call
 only listen on one NIC?

 Thanks
 Scott.




nc has:
-s addr Local source address

would that work?  It might take some scripting to figure out which
interface is using which address.

Re: httpd + php on ec2 constant crash

[matthew sporleder]

On Tue, Dec 10, 2013 at 5:43 PM, el kalin ka...@el.net wrote:


 hi all…

 i have an netbsd instance on amazon's ec2 ws. it has pretty standard
 php+mysql+httpd installation on it. everything was build from pkgs. today a
 lot of people who were accessing it got the connection reset message. many
 times.


 my https error log looks like this:

 [Tue Dec 10 17:21:56.060797 2013] [core:notice] [pid 5380] AH00052: child
 pid 22012 exit signal Segmentation fault (11)
 [Tue Dec 10 17:22:05.239618 2013] [core:notice] [pid 5380] AH00052: child
 pid 6222 exit signal Segmentation fault (11)
 [Tue Dec 10 17:22:06.257665 2013] [core:notice] [pid 5380] AH00052: child
 pid 16224 exit signal Segmentation fault (11)
 [Tue Dec 10 17:22:06.451431 2013] [core:notice] [pid 5380] AH00052: child
 pid 14182 exit signal Segmentation fault (11)
 [Tue Dec 10 17:22:10.498240 2013] [core:notice] [pid 5380] AH00052: child
 pid 8846 exit signal Segmentation fault (11)
 [Tue Dec 10 17:22:13.639382 2013] [core:notice] [pid 5380] AH00052: child
 pid 15447 exit signal Segmentation fault (11)
 [Tue Dec 10 17:22:52.149443 2013] [core:notice] [pid 5380] AH00052: child
 pid 11396 exit signal Segmentation fault (11)
 [Tue Dec 10 17:22:56.189382 2013] [core:notice] [pid 5380] AH00052: child
 pid 19213 exit signal Segmentation fault (11)
 [Tue Dec 10 17:23:19.458501 2013] [core:notice] [pid 5380] AH00052: child
 pid 1812 exit signal Segmentation fault (11)
 [Tue Dec 10 17:23:22.479650 2013] [core:notice] [pid 5380] AH00052: child
 pid 7702 exit signal Segmentation fault (11)

 i tried to attach a current httpd process to gdb but gdb dies with this:

 /usr/src/external/gpl3/gdb/dist/gdb/thread.c:81: internal-error:
 inferior_thread: Assertion `tp' failed.
 A problem internal to GDB has been detected,
 further debugging may prove unreliable.
 Quit this debugging session? (y or n)

 i was hoping somebody here can point in me in the right direction to figure
 out what exactly is happening and how can i get rid off it..

 the instance is 6.0 NetBSD 6.0 (XEN3_DOMU) amd64

 thanks..



You'll need ot rebuild with -g, but:
http://mspo.com/how-to/apache-php-gdb.html

Re: fuse ntfs-3g on USB poor performances

[matthew sporleder]

On Thu, Nov 7, 2013 at 8:53 AM,  tlaro...@polynum.com wrote:
 Hello,

 I need to do a back-up of files served by an amd64 NetBSD node (5.2.0),
 and, in case of problem, this back-up has to be readable directly by
 Windows nodes. So I use external USB connected disks (USB 3.0; the
 server has USB 3.0 ports too), formatted as NTFS, and I use
 fuse/ntfs-3g.

 But the write performance is quite poor (1.5 Mb/s).

 Is there anyway of speeding things up? From searching around, it seems
 that the bottleneck is with the driver by itself.

 TIA
 --
 Thierry Laronde tlaronde +AT+ polynum +dot+ com
   http://www.kergis.com/
   http://www.renaissance-francaise.fr/
 Key fingerprint = 0FF7 E906 FBAF FE95 FD89  250D 52B1 AE95 6006 F40C


are you referencing specific links from searching around?

I believe you that it's slow, but I'm sure it would take some research
to make any improvements.

Re: Bug in fluxbox-generate_menu?, was: Which lightweight window manager with menu auto-update?

[matthew sporleder]

On Fri, Nov 15, 2013 at 4:22 AM, Ottavio Caruso 
ottavio2006-usenet2...@yahoo.com wrote:

 On 14 November 2013 16:36, Hauke Fath h...@spg.tu-darmstadt.de wrote:
  On Thu, 14 Nov 2013 16:11:05 +, Ottavio Caruso wrote:
  I am looking for a recommendation for a lightweight manager that can
  update itself after installing new packages and doesn't list non
  existent applications.
 
  icewm does that.

 Installed icewm, no man page, odd!

 The only application listed was xterm. I am not sure how to configure
 this wm now.

  for all I know, pkgsrc does not maintain a list of (X11
  GUI) applications for window managers to peruse.

 Yes, can you expand on this. I suspect window managers won't expect to
 find applications in /usr/pkg, although it's in the $PATH.

 Going to back to fluxbox, I had this error when trying to generate a menu:

 fluxbox-generate_menu
 touch: ${HOME}/.fluxbox/menuconfig: No such file or directory
 Warning: I couldn't create ${HOME}/.fluxbox/menuconfig
 Fatal error: can't create or write to ${HOME}/.fluxbox/menu

 I researched on many forums and I thought it was a bug,

 I then found this old bug report:
 http://sourceforge.net/p/fluxbox/bugs/835/

 I believe the version of fluxbox shipped with pkgscr is an update of
 older one and it's possible that a broken fluxbox-generate_menu has
 been carried over.

 Has anybody got a working copy of fluxbox and check if this is still
 the case, before filling a bug report?


I just did a make extract and don't see your issue.

Try putting a -x on the /bin/sh in that script and get some more info.

Re: netbsd 6 instance on amazon

[matthew sporleder]

On Sat, Nov 2, 2013 at 7:10 AM, el kalin ka...@el.net wrote:


 hi all...

 i'm running an netbsd 6 (6.0 NetBSD 6.0 (XEN3_DOMU) amd64) instance on
 amazon since december last year. everything was working nicely until about 2
 months ago when the system sporadically started rebooting itself. it happens
 once a week on average. sometimes twice. the last line in the messages log
 always looks like this:

 ^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@
 ^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@Nov  2
 07:21:55 ip-10-62-123-59 syslogd[310]: restart


 it always happens right before the default daily cron (which is set for 3:15
 am by default). around 3:12 am.

 the only things the machine runs are httpd and mysqld..

 has anybody experienced this? i would greatly appreciate any thoughts that
 can resolve this problem...

 thanks...


Is there anything further up in the log to indicate a sender of that message?

Also, have you tried terminating and rebuilding (caveat data loss,
etc) to get onto another amazon host?

Re: netbsd 6 instance on amazon

[matthew sporleder]

Can you push the php log into a different facility as a first step?


On Sat, Nov 2, 2013 at 1:12 PM, el kalin ka...@el.net wrote:

 not really. this machine it's pretty busy and the php log is dumped in the
 syslog too. there are no other system messages - except php warnings.

 i do have a pre-problem image of this machine which i did put up and now
 monitoring too. but there has been a lot of work done since then and i
 rather resolve this because moving everything over will be a very
 problematic at this point

 the strange thing is that it always happens pretty much exactly at the
 same time. and there are no cron jobs that are scheduled for that time. but
 it's always a few minutes before the default daily cron at 3:15. like i
 said it doesn't happened every day but this week happened twice and it gets
 to be annoying since i don't get to know about it until later in the
 morning...

 thanks...





 On Sat, Nov 2, 2013 at 11:20 AM, matthew sporleder 
 msporle...@gmail.comwrote:

 On Sat, Nov 2, 2013 at 7:10 AM, el kalin ka...@el.net wrote:
 
 
  hi all...
 
  i'm running an netbsd 6 (6.0 NetBSD 6.0 (XEN3_DOMU) amd64) instance on
  amazon since december last year. everything was working nicely until
 about 2
  months ago when the system sporadically started rebooting itself. it
 happens
  once a week on average. sometimes twice. the last line in the messages
 log
  always looks like this:
 
 
 ^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@
  ^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@Nov  2
  07:21:55 ip-10-62-123-59 syslogd[310]: restart
 
 
  it always happens right before the default daily cron (which is set for
 3:15
  am by default). around 3:12 am.
 
  the only things the machine runs are httpd and mysqld..
 
  has anybody experienced this? i would greatly appreciate any thoughts
 that
  can resolve this problem...
 
  thanks...


 Is there anything further up in the log to indicate a sender of that
 message?

 Also, have you tried terminating and rebuilding (caveat data loss,
 etc) to get onto another amazon host?

Re: Apache with VitualHost ?

[matthew sporleder]

Put your new config and the output from 'httpd -S' on a paste bin and
I will take a look.

Also try asking for some real time help in irc.freenode.net #httpd


On Sat, Oct 26, 2013 at 8:59 AM, Maurizio Caloro mau...@gmx.ch wrote:
 Hello Dear Matt
 Thanks for your Quick Answer!

 I have done all the changes but stil the same the HomeShine site are not
 Available
 the Path to this folder are all Ok and i don't know why this error allso
 ocure.
 Thanks for your help
 Regards
 Mauri

 Am 26.10.2013 14:11, schrieb Maurizio Caloro:
 Am 26.10.2013 13:39, schrieb Matt Sporleder:

 hometime is not homeshine
 Yes this mod now i have change, but stil the same, no Webpage appair


 On Oct 26, 2013, at 7:14 AM, Maurizio Caloro mau...@gmx.ch wrote:

 Hello Together
 After try to configure Apache with virtualhost, i have the problem that
 the second link homeshine are not available.
 -Caloro are Browsable = OK
 -HomeShine
 ony for local Network, but are not Available.
 For any Help iam Happy
 Regards
 Mauri

 [Snip-http.conf]
 # Virtual hosts
 Include etc/httpd/httpd-vhosts.conf

 [Snip-http-Vhost.conf]
 NameVirtualHost *:80

 VirtualHost *:80
 ServerAdmin webmas...@caloro.ch
 DocumentRoot /usr/pkg/share/httpd/htdocs/caloro.ch/
 ServerName caloro.ch
 ServerAlias www.caloro.ch
 Directory /usr/pkg/share/httpd/htdocs/caloro.ch/
Options Indexes FollowSymLinks
AllowOverride None
Order allow,deny
Allow from all
 /Directory
IfModule dir_module
DirectoryIndex index.html
/IfModule
 ErrorLog /var/log/httpd/caloro_error.logs
 TransferLog /var/log/httpd/caloro_trans.logs
 /VirtualHost

 VirtualHost *:80
 ServerAdmin webmas...@homeshine.ch
 DocumentRoot /usr/pkg/share/httpd/htdocs/homeshine.ch/
 ServerName homeshine.ch
 ServerAlias www.homeshine.ch
 Directory /usr/pkg/share/httpd/htdocs/homeshine.ch/
Options Indexes FollowSymLinks
AllowOverride None
Order allow,deny
Allow from all
 /Directory
IfModule dir_module
DirectoryIndex index.html
/IfModule
 ErrorLog /var/log/httpd/homeshine_error.logs
 TransferLog /var/log/httpd/homeshine_trans.logs
 /VirtualHost

 [Snip-Error.conf]
 [Sat Oct 26 13:03:36 2013] [notice] Digest: generating secret for digest
 authentication ...
 [Sat Oct 26 13:03:36 2013] [notice] Digest: done
 [Sat Oct 26 13:03:37 2013] [notice] Apache/2.2.25 (Unix) DAV/2
 configured -- resuming normal operations

 [Snip-hosts]
 192.168.0.103   homeshine.ch caloro.ch

Re: Few notesquestions on NetBSD building and on wedges included by default

[matthew sporleder]

On Tue, Sep 24, 2013 at 2:33 PM, scft s...@yandex.com wrote:
 Hi, NetBSD mailing lists.

 I'm intending to cross-build NetBSD to try it out. I very much liked project 
 goals, as well as emphasis on code clarity and portability.
 Minimalism and perfectionism are attractive.
 However, i have one practical question (which is 2.) and a few 
 suggestions\fixes on building process.

 1. I'm actually do cross-building because installer fails with wd0: device 
 busy (googling for further info i found out that it's because of some thing 
 called wedges.).
 Then why to include this unnecessary whistle by default? The goal of defaults 
 is by definition to fit to most users. Either fix sysinst, or kernel config!


I'm not sure this is necessarily the case, but why not?


 2. The only value for x86 architecture is i386. Which obviously means that 
 new features from i486 are not included, sse is (i guess) not included, amd 
 k8  opteron optimizations are not included... It is possible to fine-tune 
 these settings in FreeBSD (see: 
 http://svnweb.freebsd.org/base/head/share/mk/bsd.cpu.mk?view=co). Judging by 
 absence of such in /usr/share/mk of NetBSD, it is not possible to get this 
 without DIY there. Why not to implement and document this?
 It is not even explained anywhere, what's the difference between MACHINE and 
 MACHINE_ARCH. BUILDING says that MACHINE_ARCH should always be an exact 
 architecture, MACHINE may be not. And it says that by saying that first is 
 architecture, second is type Very straightforward.



You may not want to make so many assumptions about x86/i386.
FreeBSD build system is not the same as NetBSD.  The make files are different.



 3. I've also found a bug in BUILDING documentation file. It says that 
 HOST_CXX is a C++ compiler. Yet setting HOST_CXX to g++ makes build,sh fail 
 with messages like C preprocessor fails sanity check. By setting HOST_CXX 
 to c preproc, i have no such messages.

 4. There is no option to actually set c++ compiler then. Groff needs it and 
 fails without it. So i have a choice between hacking makefiles and setting 
 MKGROFF=no. I chose second - nobody loves to hack makefiles. Especially those 
 makefiles that are written by other people.
 I suggest you to implement HOST_CPLUS feature.
 CPLUS, not CPP. So that nobody'll be confused with cpp\cxx.


I'm willing to bet this is more of an issue with how you executed the build.


 5. mk.conf is somewhat badly documented. E.g. i've found new mk.conf options 
 in makefiles, which are not listed in documentation. Some options listed in 
 mk.conf(5) are not listed in BUILDING or handbook, and vice versa.



true


 6. libc fails to build with MKPICLIB=no, saying that '-lgcc is not found'. 
 Even though i've found that i actually need MKPICLIB set to yes, seem as a 
 bug. (This happened when i tried to crossbuild it on both FreeBSD and on an 
 unpopular Ubuntu Linux derivative.)

how are you executing build.sh?

Re: dovecot again/still

[matthew sporleder]

On Tue, Oct 8, 2013 at 12:53 PM, Steve Blinkhorn st...@prd.co.uk wrote:
 So I grabbed your tarball, moved everything under /usr/pkg/etc/dovecot
 into a subdirector, and replaced with your tarball contents.   Small
 changes to the pathname and filenames for the cert and the key and -
 same error message.

 It's clearly the case that dovecot is providing at least some
 services, for instance what appear to be successful logins.  But my
 postmaster mailbox is filling up with error reports, including
 transcripts that look like this:

  In:  STARTTLS
  Out: 454 4.3.0 TLS not available due to local problem
  In:  MAIL FROM: SIZE=6613
  Out: 250 2.1.0 Ok
  In:  RCPT TO:rmtme...@prd.co.uk
  Out: 450 4.1.1 rmtme...@prd.co.uk: Recipient address rejected: User
 unknown
  in local recipient table
  In:  QUIT
  Out: 221 2.0.0 Bye

 I'm doing all this on a NetBSD 4.0.1 system that is destined to be
 replaced soon, so I thought I would get familiar with dovecot on a
 machine whose configuration I know well.   I'm wondering whether this
 is maybe a bug in dovecot2 that has been corrected since the tarball I
 started from (off the NetBSD.org site) was created.

 --
 Steve Blinkhorn st...@prd.co.uk

 You wrote:

 On Tue, Oct 8, 2013 at 11:43 AM, Steve Blinkhorn st...@prd.co.uk wrote:
  I am gradually getting dovecot to work with my established postfix
  configuration, but can't find a way past this error (from
  /var/log/maillog):
 
  Oct  8 16:26:52 body dovecot: master: Error: Error reading
  configuration: Invalid settings: No services defined
 
  I'm assuming that I should be looking in conf.d/10-master.conf for the
  error, but lack of familiarity with the syntax of the conf files is
  making it hard to see what's wrong.
 
  Is there a way of getting a report of which services are defined so I
  can test without exposing my live system to errors?
  --
  Steve Blinkhorn st...@prd.co.uk
 


 Hey I was just thinking about your previous email last night when I
 had to re-do my dovecot install from scratch!  :)

 Just to be 100% sure, you have mail/dovecot2 installed and not
 mail/dovecot, right?
 Anyway, you can find my entire config here:
 www.mspo.com/nc/dovecot.tar.gz

 Also my postfix config has this kind of stuff:
 #accepting mail - auth to dovecot
 smtpd_sasl_type = dovecot
 smtpd_sasl_path = private/auth
 smtpd_sasl_auth_enable = yes
 smtpd_sasl_security_options = noanonymous
 smtpd_recipient_restrictions = permit_mynetworks,
 permit_sasl_authenticated, reject_unauth_destination



 --
 Steve Blinkhorn st...@prd.co.uk

 
 This email is for the addressee only.   If you are not the addressee
 you should immediately delete this email from your system(s) and
 inform us.   It may contain information that is confidential or
 otherwise privileged, and should not be copied or redistributed to
 recipients not originally specified as addressees without permission.

 S F Blinkhorn MA PhD CPsychol FBPsS, Managing Director,
 Psychometric Research  Development Ltd.
 PO Box 1143, St Albans, Herts, AL1 9UT, UK
 Registered in England No. 1909571
 Registered Office: 47 Holywell Hill, St Albans, Herts, AL1 1HD
 Phone: +44 (0)1727 841455
 http://www.prd.co.uk
 


Okay,  I think you are firmly into postfix config problems now.

Also I am attempting to deliver mail to my locally defined users (as
in /etc/passwd).

I have a feeling my postfix TLS settings are less strict than yours..

postconf -c /usr/pkg/etc/postfix
smtpd_enforce_tls = no
smtpd_sasl_type = dovecot

Re: Various size of (Project) ideas for NetBSD and pkgsrc

[matthew sporleder]

On Sun, Sep 29, 2013 at 1:58 PM, Ryo ONODERA ryo...@yk.rim.or.jp wrote:

 Hi,

 From: matthew sporleder msporle...@gmail.com, Date: Sun, 29 Sep 2013
 13:41:55 -0400

 
  I have noted some places where you might find similar projects.
 
  Also you should not feel intimidated to add these yourself to the wiki.
  It's very easy to fix spellings, etc, as needed.
  It's more difficult to express your ideas beyond how you state them.  :)
 
  The project template is very easy to use!

 Thanks for your links.

 I feel that some ideas may not be relevant to
 http://wiki.netbsd.org/projects/ .
 How do you think threshold of adding ideas to projects wiki page?

 Thank you.

 --
 Ryo ONODERA // ryo...@yk.rim.or.jp
 PGP fingerprint = 82A2 DC91 76E0 A10A 8ABB  FD1B F404 27FA C7D1 15F3



As I read it, projects are enhancements and new ideas.  Fixes, on the other
hand, are fixes.  :)

In your case the broken MIPS stuff seems out of scope for the projects page
even though it is likely a large project in the sense that it requires a
lot of work.

I'm not the gatekeeper, but that's how I see the current projects page.

Re: netbsd-6.1: squid from pkgsrc-2013-Q2 uses too much CPU time

[matthew sporleder]

ktrace is a command, look it up.

also testing dns time was a very good suggestion, as well.


On Sun, Sep 15, 2013 at 7:12 AM, Adrian Immanuel Kieß adr...@kiess.atwrote:

 Dear List, Metthew and Matthias,

 I don't know how to trace a application within NetBSD -- and yes it must
 be cache related. After migrating, if I remeber right, I even tried to
 rebuild the cache by hand to check if everything is OK.

 I guess it loops around somewhere with wrong OPENDEV command for the
 network interface. My second guess it is busy scanning the HTML file or
 something. I just can guess. :-)

 I even added max_filedescriptors 4096 in squid.conf because I've
 stumbled across something with the open file limit in NetBSD already.
 ^_^

 As I already noted it worked under Debian.

 But under NetBSD 6.1 I now have the high CPU usage.

 I attached my squid.conf file.

 Adrian Immanuel KIESS

 On Sat, 2013-09-14 at 14:24 -0400, matthew sporleder wrote:
 
  On Thu, Sep 12, 2013 at 11:22 PM, Adrian Immanuel Kieß
  adr...@kiess.at wrote:
  Dear list,
 
  since several months and upgrades I encountered the problem
  that squid
  uses too much CPU time under NetBSD 6.1 and my proxy server is
  nearly to
  unusable now.
 
  I installed the default squid from /usr/pkgsrc/www/squid using
  pkgsrc-2013-Q2. Every HTTP webpage request lets squid meditate
  for
  several seconds until the page is served. The network download
  itself
  seems comparatively fast.
 
  Maybe someone seen this behavior of squid too and give me a
  hint? I
  moved my squid installation from GNU/Debian to this NetBSD box
  and I
  remember -- there I did not have this problem with nearly the
  same
  configuration.
 
  Thank you very much!
 
  Sincerely,
 
  Adrian Immanuel KIESS
 
  --
  With greetings from Leipzig, Germany.
  Adrian Immanuel Kieß
 
  Administrator  programmer
  Unix / Perl / LaTeX
 
  mail: adrian (at) kiess.at
  www: http://www.kiess.at
 
 
 
  Have you tried ktrace-ing squid to see what it's doing during these
  pauses?
 
  It sounds like it's probably scanning/writing the cache?
 

 --
 With greetings from Leipzig, Germany.
 Adrian Immanuel Kieß

 Administrator  programmer
 Unix / Perl / LaTeX

 mail: adrian (at) kiess.at
 www: http://www.kiess.at

Re: netbsd-6.1: squid from pkgsrc-2013-Q2 uses too much CPU time

[matthew sporleder]

On Thu, Sep 12, 2013 at 11:22 PM, Adrian Immanuel Kieß adr...@kiess.atwrote:

 Dear list,

 since several months and upgrades I encountered the problem that squid
 uses too much CPU time under NetBSD 6.1 and my proxy server is nearly to
 unusable now.

 I installed the default squid from /usr/pkgsrc/www/squid using
 pkgsrc-2013-Q2. Every HTTP webpage request lets squid meditate for
 several seconds until the page is served. The network download itself
 seems comparatively fast.

 Maybe someone seen this behavior of squid too and give me a hint? I
 moved my squid installation from GNU/Debian to this NetBSD box and I
 remember -- there I did not have this problem with nearly the same
 configuration.

 Thank you very much!

 Sincerely,

 Adrian Immanuel KIESS

 --
 With greetings from Leipzig, Germany.
 Adrian Immanuel Kieß

 Administrator  programmer
 Unix / Perl / LaTeX

 mail: adrian (at) kiess.at
 www: http://www.kiess.at



Have you tried ktrace-ing squid to see what it's doing during these pauses?

It sounds like it's probably scanning/writing the cache?

Re: pkgsrc use curl or wget

[matthew sporleder]

On Wed, Jul 10, 2013 at 10:04 PM, Victor Aurélio Santos
victoraur.san...@gmail.com wrote:
 Hi,

 Is possible make use curl or wget in make ?

 fetch is terrible here, it have 2 bugs, first in files larger than 1mb
 it hangs on +/- 99% and ETA say stalled I've searched about this and
 apparently this occur when using a proxy, but the problem is that I'm
 behind a transparent proxy (ISP's transparent proxy).
 the second bug is the speed of downloads in fetch, it's speed is half
 of wget or curl.

 and finally, I personally prefer curl!


Try FETCH_USING= curl in mk.conf

I know you can use it in individual packages so maybe it will just work.

Re: Please help Apache Segmentation fault

[matthew sporleder]

On Fri, Apr 26, 2013 at 9:08 AM, Mihai Chelaru
mihai.chel...@ngnetworks.ro wrote:

 Hello,

 I am seeing [notice] child pid 16566 exit signal Segmentation fault (11)
 in my apache error_log. There is something like 66790 in maybe 1 or 2 days.
 I think this problem is being caused by php. Also, I am getting many core
 dumps from apache. I wonder if this could be causing the issue that I am
 having with sokva. Since the child process does not exit cleanly, could it
 be leaving things in the kernel, eventually filling the kernel's sokva area?
 I now have my kern.somaxkva = 100663296. This is not helping. If I don't
 reboot the system everyday, then all apache processes go into a stat of
 sokva. I am desperate to find a solution!

 Thanks,
 Al


 For Google archiving - happened to me also after a pkgin full-upgrade to
 pkgsrc-2012Q4 binaries on a 6.0 system. pkgin updated apache and apr-util
 but didn't updated apr (version was unchanged). Executing pkgin -F install
 apr fixed the problem for me.

 --
 Mihai


Can you rebuild with debugging symbols?  It's easier to confirm who is
crashing apache that way.

You might also be able to examine the core files you already have.