Re: Leap second tonight

2009-01-01 Thread Simon Lockhart
On Wed Dec 31, 2008 at 04:53:57PM -0800, Wil Schultz wrote:
 At which point my Solaris 10 v490's reboot in unison, lovely.
 
 Anyone else see anything interesting?

I had a couple of Oracle servers (Solaris 10) reboot a couple of minutes
just before the leap second. All my other Solaris 10 boxes appear to have
stayed up fine.

Simon



Re: Leap second tonight

2009-01-01 Thread Jim Popovitch
On Thu, Jan 1, 2009 at 04:15, Simon Lockhart si...@slimey.org wrote:
 On Wed Dec 31, 2008 at 04:53:57PM -0800, Wil Schultz wrote:
 At which point my Solaris 10 v490's reboot in unison, lovely.

 Anyone else see anything interesting?

 I had a couple of Oracle servers (Solaris 10) reboot a couple of minutes
 just before the leap second. All my other Solaris 10 boxes appear to have
 stayed up fine.

Have either of you determined if this was a OS reboot and not a bios reset?

-Jim P.



Re: Leap second tonight

2009-01-01 Thread Simon Lockhart
On Thu Jan 01, 2009 at 04:29:35AM -0500, Jim Popovitch wrote:
 Have either of you determined if this was a OS reboot and not a bios reset?

I've been trawling through all the logfiles I can find on the box, and I see
normal entries up until 23:59:xx, and then the next entry is stuff restarting.
Could well be a BIOS/LOM reset, but it's odd that the only two boxes affected
were my Oracle servers.

Simon



Re: Leap second tonight

2009-01-01 Thread Wil Schultz
All of my Solaris 10 boxes stayed up with the exception of the Oracle  
10g RAC boxes.


db1:~ wschultz$ uname -a
SunOS db1 5.10 Generic_137111-01 sun4u sparc SUNW,Sun-Fire-V490

A friend of mine had his RAC boxes reboot as well, similar  
configuration. I've poured through the logs and see normal activity  
until the reboot, nothing suspicious and no reason for the reboot.  
Seems to be specific to Solaris 10 running RAC on this end.


-wil

On Jan 1, 2009, at 2:36 AM, Simon Lockhart wrote:


On Thu Jan 01, 2009 at 04:29:35AM -0500, Jim Popovitch wrote:
Have either of you determined if this was a OS reboot and not a  
bios reset?


I've been trawling through all the logfiles I can find on the box,  
and I see
normal entries up until 23:59:xx, and then the next entry is stuff  
restarting.
Could well be a BIOS/LOM reset, but it's odd that the only two boxes  
affected

were my Oracle servers.

Simon






Re: Leap second tonight

2009-01-01 Thread Simon Lockhart
On Thu Jan 01, 2009 at 07:58:21AM -0800, Wil Schultz wrote:
 All of my Solaris 10 boxes stayed up with the exception of the Oracle  
 10g RAC boxes.

My Oracle boxes that rebooted were running RAC (version 10G R2), too. Another
Solaris 10 box running the same version of Oracle, but not RAC, did not reboot.

Looks rather like an Oracle 10 RAC bug.

Simon



Hijacking and Tools BOF Nanog 45 - Call for participants

2009-01-01 Thread Joel Jaeggli
Greetings and happy new year,

As Nanog 45 is quickly approaching, I would encourage anyone who has
been thinking about the problem of address hijacking and mitigation
within the framework of our existing routing system to consider
participating in the Hijack and Tools BOF at, in Santo Domingo. We have
sufficient space in the agenda for the Sunday afternoon BOF to
accommodate some additional participants.

Discussions from both tools developers and operators with deployment
experience with opsen-source or commercial tools are encouraged, as well
as filtering policy, strategy for communicating with peer network
operators to coordinate response and related topics within the sphere of
ip hijacking response.

Thanks and Looking forward to seeing you all in Santo Domingo.
Joel



NANOG 45 PGP signing party.

2009-01-01 Thread Joel Jaeggli
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Just a quick note,

The thrice annual NANOG pgp key signing party will be making an
appearance at NANOG 45.

The keysigning sessions are going to be during the morning breaks during
the general session, and will be location TDB.

Monday  January 26th11:00-11:30
Tuesday January 27th11:00-11:30

If you plan to participate, please add your key to the keyring at:

https://biglumber.com/x/web?keyring=9210

Then come to one or both sessions with some form of government issued
photo ID.

If you have any further questions, feel free to contact me via email or
corner one of the people with the pgp signing dots since they mostly
know the score.

While printouts will probably be available at the sessions, feel free to
add your key to the keyring right up to the time of the last keysigning
event.

Thanks
Joel

-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org

iEYEARECAAYFAkldCqwACgkQ8AA1q7Z/VrKoQACfSgOEzqbSplmCyKPmhc6Y13fu
M3AAn1ZcEXMCqLvu0c7TAyDpjSuWLoIZ
=Ie47
-END PGP SIGNATURE-



Re: Leap second tonight

2009-01-01 Thread Stefan Molnar

What FS do you have on your RAC?  And do you have a log of console?

We do not have 10g R2 on Solaris, but with the random issues we have seen.  
Oracle could have fenced each other off.  We noticed that some errors do not 
show up anywhere than console, so we run conserver and dump all console out to 
log.



--Original Message--
From: Simon Lockhart
Sender: 
To: Wil Schultz
Cc: NANOG list
Sent: Jan 1, 2009 8:13 AM
Subject: Re: Leap second tonight

On Thu Jan 01, 2009 at 07:58:21AM -0800, Wil Schultz wrote:
 All of my Solaris 10 boxes stayed up with the exception of the Oracle  
 10g RAC boxes.

My Oracle boxes that rebooted were running RAC (version 10G R2), too. Another
Solaris 10 box running the same version of Oracle, but not RAC, did not reboot.

Looks rather like an Oracle 10 RAC bug.

Simon







Re: Leap second tonight

2009-01-01 Thread Steven Saner

Jon Meek wrote:

My Solaris 10 boxes are all happy (and did not reboot). I monitor NTP
on a number
of devices, including one router. The router was off by one second for
a while, but
is OK after an hour. Everything else was fine immediately.

In 2005, our CDMA clock got the leap second between 15:08 and 15:38
EST creating
some issues due to disagreement with the (too few) GPS clocks.

Jon

On Wed, Dec 31, 2008 at 7:53 PM, Wil Schultz wschu...@bsdboy.com wrote:

At which point my Solaris 10 v490's reboot in unison, lovely.

Anyone else see anything interesting?

-wil


I run a bunch of Slackware Linux boxes of varying versions. As best as I can 
tell, at or around 00:00 UTC all of my Slackware 12.0 boxes crashed with a 
kernel panic. I don't think it is ntpd because it is the same version as on 12.1 
boxes (4.2.4p0) that did not crash. It may be the kernel: 2.6.21.5


Anyone else experience similar or was this coincidental and I have other 
issues...

Steve

--
--
Steven Saner ssa...@hubris.net  Voice:  316-858-3000
Director of Network Operations  Fax:  316-858-3001
Hubris Communicationshttp://www.hubris.net



Re: Leap second tonight

2009-01-01 Thread Chris Adams
Once upon a time, Steven Saner ssa...@hubris.net said:
 I run a bunch of Slackware Linux boxes of varying versions. As best as I 
 can tell, at or around 00:00 UTC all of my Slackware 12.0 boxes crashed 
 with a kernel panic. I don't think it is ntpd because it is the same 
 version as on 12.1 boxes (4.2.4p0) that did not crash. It may be the 
 kernel: 2.6.21.5
 
 Anyone else experience similar or was this coincidental and I have other 
 issues...

I had one (out of many, including about a half dozen identically
configured) Red Hat Enterprise Linux 4 systems hang at the leap second.

There have been some messages on the NTP list referencing posts on a
Debian list about leap second crashes, and there's a post on /. about a
similar problem with Fedora 8.

-- 
Chris Adams cmad...@hiwaay.net
Systems and Network Administrator - HiWAAY Internet Services
I don't speak for anybody but myself - that's enough trouble.