Re: this 48-core box...

2013-09-19 Thread Dennis Glatting



On Thu, 19 Sep 2013, Vincent Schut wrote:


On Tue, 17 Sep 2013 12:08:43 -0500
Michael Chen mich...@foxbatcapital.com wrote:


I'm considering bidding on this 48-core box:

http://www.ebay.com/itm/Supermicro-A-Server-1042G-TF-1U-H8QG6-4-CPUS-48-cores-2-2Ghz-128GB-RAM-/151119828428?pt=COMP_EN_Servershash=item232f7195cc

Does anyone have experience with it and can I use all the cores?

Thanks!
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to
freebsd-questions-unsubscr...@freebsd.org



I recently bought one like that (48 cores but 'only' 96 Gb ram). It was
meant to play a double role as both zfs file server and data processing
server (we do lots of satellite image processing), running FreeBSD 9.1.
It connects with a SAN and we'll use it to process about 36TB of
satellite data in the next months. (In a couple of weeks we will
probably have budget to split those roles, and buy a dedicated file
server.) After several weeks of tweaking and testing, I can say that:
- the zfs/file server part runs without problems
- the satellite data processing had problems scaling to all 48 cores, I
 got max performance when running about 18 processes in parallel,
 scaling up more would lower the overall performance. However, this
 (sorry guys) appeared to be a FreeBSD problem, and not a hardware
 problem. As a test I switched to linux with ZoL (ZFS on Linux), and,
 though zfs performance is less compared to freebsd, data processing
 is much much better, like a factor 12 or so.



I've noticed this same scaling problem on 32+ core servers but haven't had 
a chance to look into the detail. From the performance graphs I am 
confused whether my problems are processing problems or a data I/O 
problem.




Conclusion: the hardware is alright, however when needed to do lots of
heavy calculations on terabytes of data, the combination with FreeBSD
appears not ideal.

Of course it is you get what you pay for. Decent, OK working hardware,
but none of the special handy-dandy features expensive brands will give
you. If you don't need them, in my experience it is decent hardware for
a good price.

regards,
Vincent.

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: this 48-core box...

2013-09-17 Thread Dennis Glatting



On Tue, 17 Sep 2013, Michael Chen wrote:


I'm considering bidding on this 48-core box:

http://www.ebay.com/itm/Supermicro-A-Server-1042G-TF-1U-H8QG6-4-CPUS-48-cores-2-2Ghz-128GB-RAM-/151119828428?pt=COMP_EN_Servershash=item232f7195cc

Does anyone have experience with it and can I use all the cores?




I have one of those boards running 32 cores. You MUST run FreeBSD 9+ if 
you want access to more than 32 cores.


Currently there is a bug in the stable/9 mfs drivers that do not allow you 
to boot from a RAID array. I believe a patch has been submitted. I have a 
copy of the patch and it works fine.


I have had significant problems with ZFS under stable/9 however I haven't 
tried recent updates, rather I had to punt back to stable/8 (production 
machine).


I have 22 3TB disks, 4 256GB SSDs, 256GB RAM, and 4x16 cores on my 
machine. I also have a 10GbE cardin my machine that runs fine.


I DO NOT use the CD.

Other than the issues I mentioned, runs fine.



___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: this 48-core box...

2013-09-17 Thread Dennis Glatting


Forgot to mention:

1) My board is mounted in a SC848 Chassis and I use active cooling.

2) DO NOT run a chassis like the SC848 with the top off or the disks will 
overheat. :)




On Tue, 17 Sep 2013, Michael Chen wrote:


I'm considering bidding on this 48-core box:

http://www.ebay.com/itm/Supermicro-A-Server-1042G-TF-1U-H8QG6-4-CPUS-48-cores-2-2Ghz-128GB-RAM-/151119828428?pt=COMP_EN_Servershash=item232f7195cc

Does anyone have experience with it and can I use all the cores?

Thanks!
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: this 48-core box...

2013-09-17 Thread Dennis Glatting



On Tue, 17 Sep 2013, iamatt wrote:


Hi.   Not sure if you can use all cores.   It has been and still is my
experience that SM is crap.   We have several SM gpu and SM/Calxeda  Arm
clusters and they really lack in may ways from ipmi to chassis management
to the corners they cut with the processor to memory mappings.

I would consider looking at SGI UV,  ultraviolet system for a fat node type
system but they are not cheap.   We have plenty of those and they can build
it the way you want.   Lead time is a couple of months due to build  to
order.   Support from SM sucks too. :)
On Sep 17, 2013 12:17 PM, Michael Chen mich...@foxbatcapital.com wrote:



I have three personal systems and two work systems running using the H8DG6 
MBs and they work fine.





I'm considering bidding on this 48-core box:

http://www.ebay.com/itm/**Supermicro-A-Server-1042G-TF-**
1U-H8QG6-4-CPUS-48-cores-2-**2Ghz-128GB-RAM-/151119828428?**
pt=COMP_EN_Servershash=**item232f7195cchttp://www.ebay.com/itm/Supermicro-A-Server-1042G-TF-1U-H8QG6-4-CPUS-48-cores-2-2Ghz-128GB-RAM-/151119828428?pt=COMP_EN_Servershash=item232f7195cc

Does anyone have experience with it and can I use all the cores?

Thanks!
__**_
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/**mailman/listinfo/freebsd-**questionshttp://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-**
unsubscr...@freebsd.org freebsd-questions-unsubscr...@freebsd.org


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: this 48-core box...

2013-09-17 Thread Dennis Glatting



On Tue, 17 Sep 2013, iamatt wrote:


Hi.   Not sure if you can use all cores.   It has been and still is my
experience that SM is crap.   We have several SM gpu and SM/Calxeda  Arm
clusters and they really lack in may ways from ipmi to chassis management
to the corners they cut with the processor to memory mappings.



Just to clarify:

My use is simply as servers and workstations. Generally I don't use IPMI 
on these systems. I have had trouble with the PCIe slots. Specifically, on 
the dual core boards some slots are serviced by one set of hardware and 
other slots by other sets of hardware. Consequently, if you don't have all 
cores populated then corresponding PCIe slots will not work.


Can't say about the four core system, though.




I would consider looking at SGI UV,  ultraviolet system for a fat node type
system but they are not cheap.   We have plenty of those and they can build
it the way you want.   Lead time is a couple of months due to build  to
order.   Support from SM sucks too. :)
On Sep 17, 2013 12:17 PM, Michael Chen mich...@foxbatcapital.com wrote:


I'm considering bidding on this 48-core box:

http://www.ebay.com/itm/**Supermicro-A-Server-1042G-TF-**
1U-H8QG6-4-CPUS-48-cores-2-**2Ghz-128GB-RAM-/151119828428?**
pt=COMP_EN_Servershash=**item232f7195cchttp://www.ebay.com/itm/Supermicro-A-Server-1042G-TF-1U-H8QG6-4-CPUS-48-cores-2-2Ghz-128GB-RAM-/151119828428?pt=COMP_EN_Servershash=item232f7195cc

Does anyone have experience with it and can I use all the cores?

Thanks!
__**_
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/**mailman/listinfo/freebsd-**questionshttp://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-**
unsubscr...@freebsd.org freebsd-questions-unsubscr...@freebsd.org


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Problems with stable/9 and LSI controlers?

2013-09-10 Thread Dennis Glatting


Today I updated several systems against stable/9 that had not bee updated 
in ~five months. Two of the systems are serviced by LSI 2008 controllers 
with a RAID1 array housing the operating system.


These systems no longer properly boot.

Specifically, they begin the boot process but bomb when they try to mount 
root. Neither system sees the GPT partitions of the boot disk at the 
mountroot prompt. On one system I replaced the hard disks, 
repartitioned, and reinstalled but the problem continued.


I don't see any mention of geom or controller update in UPDATING but I 
know they have been updated because I saw their revisions fly actross my 
screen during the svn update. Also, I am running IR vers 16 on my 
controllers, which is the latest version of LSI firmware.


Is there some new action I have to take to sucessfully boot LSI disks 
against the updated kernel?



___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Problems with stable/9 and LSI controlers?

2013-09-10 Thread Dennis Glatting


Whatever changed, happened between r253683 (July 26) and r255451 (today).


On Tue, 10 Sep 2013, Dennis Glatting wrote:



Today I updated several systems against stable/9 that had not bee updated in 
~five months. Two of the systems are serviced by LSI 2008 controllers with a 
RAID1 array housing the operating system.


These systems no longer properly boot.

Specifically, they begin the boot process but bomb when they try to mount 
root. Neither system sees the GPT partitions of the boot disk at the 
mountroot prompt. On one system I replaced the hard disks, repartitioned, 
and reinstalled but the problem continued.


I don't see any mention of geom or controller update in UPDATING but I know 
they have been updated because I saw their revisions fly actross my screen 
during the svn update. Also, I am running IR vers 16 on my controllers, which 
is the latest version of LSI firmware.


Is there some new action I have to take to sucessfully boot LSI disks against 
the updated kernel?



___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Problems with stable/9 and LSI controlers?

2013-09-10 Thread Dennis Glatting



On Tue, 10 Sep 2013, Kenneth D. Merry wrote:


On Tue, Sep 10, 2013 at 11:21:02 -0700, Dennis Glatting wrote:


Today I updated several systems against stable/9 that had not bee updated
in ~five months. Two of the systems are serviced by LSI 2008 controllers
with a RAID1 array housing the operating system.

These systems no longer properly boot.

Specifically, they begin the boot process but bomb when they try to mount
root. Neither system sees the GPT partitions of the boot disk at the
mountroot prompt. On one system I replaced the hard disks,
repartitioned, and reinstalled but the problem continued.

I don't see any mention of geom or controller update in UPDATING but I
know they have been updated because I saw their revisions fly actross my
screen during the svn update. Also, I am running IR vers 16 on my
controllers, which is the latest version of LSI firmware.

Is there some new action I have to take to sucessfully boot LSI disks
against the updated kernel?


Can you try the mpslsi driver from LSI's web site and see if that works?

If it does, then it is a problem we've introduced locally.



I'll give it a shot but just to be clear, I have been running the 16 
firmware for months.


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Problems with stable/9 and LSI controlers?

2013-09-10 Thread Dennis Glatting



On Tue, 10 Sep 2013, Kenneth D. Merry wrote:


On Tue, Sep 10, 2013 at 12:35:02 -0700, Dennis Glatting wrote:

On Tue, 10 Sep 2013, Kenneth D. Merry wrote:

On Tue, Sep 10, 2013 at 12:11:38 -0700, Dennis Glatting wrote:

On Tue, 10 Sep 2013, Kenneth D. Merry wrote:


On Tue, Sep 10, 2013 at 11:21:02 -0700, Dennis Glatting wrote:


Today I updated several systems against stable/9 that had not bee
updated
in ~five months. Two of the systems are serviced by LSI 2008 controllers
with a RAID1 array housing the operating system.

These systems no longer properly boot.

Specifically, they begin the boot process but bomb when they try to
mount
root. Neither system sees the GPT partitions of the boot disk at the
mountroot prompt. On one system I replaced the hard disks,
repartitioned, and reinstalled but the problem continued.

I don't see any mention of geom or controller update in UPDATING but I
know they have been updated because I saw their revisions fly actross my
screen during the svn update. Also, I am running IR vers 16 on my
controllers, which is the latest version of LSI firmware.

Is there some new action I have to take to sucessfully boot LSI disks
against the updated kernel?


Can you try the mpslsi driver from LSI's web site and see if that works?

If it does, then it is a problem we've introduced locally.



I'll give it a shot but just to be clear, I have been running the 16
firmware for months.


The issue is very likely in the driver, not the firmware.  I'm just
trying to figure out whether it broke in LSI's Phase 16 or in our
additional changes in FreeBSD.

In any case, I've reproduced the problem, and hopefully I'll know soon
where the issue is.

So don't worry about trying LSI's driver.  Just go back to the previous
version of stable/9 that worked for you until we fix it.

This only affects RAID volumes, not regular disks.



Thanks.

I downloaded the mpslsi.ko driver from LSI under r255451 and the system
now boots.


Okay, try the attached patch with the new driver and see whether it fixes
the problem for you.

The issue was that with the new rescanning code, we weren't rescanning RAID
volumes that got created.

It fixes the problem for me with a RAID-1 volume.



The patch worked for one of my servers. I can't test the second server 
until tonight however the problem is the same.




There is still the issue of all of the verbose probe errors that crop up
when an Integrated RAID volume is enabled, but it isn't obvious at the
moment whether we can easily fix that.


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Problems with stable/9 and LSI controlers?

2013-09-10 Thread Dennis Glatting



On Tue, 10 Sep 2013, Kenneth D. Merry wrote:


On Tue, Sep 10, 2013 at 12:11:38 -0700, Dennis Glatting wrote:

On Tue, 10 Sep 2013, Kenneth D. Merry wrote:


On Tue, Sep 10, 2013 at 11:21:02 -0700, Dennis Glatting wrote:


Today I updated several systems against stable/9 that had not bee updated
in ~five months. Two of the systems are serviced by LSI 2008 controllers
with a RAID1 array housing the operating system.

These systems no longer properly boot.

Specifically, they begin the boot process but bomb when they try to mount
root. Neither system sees the GPT partitions of the boot disk at the
mountroot prompt. On one system I replaced the hard disks,
repartitioned, and reinstalled but the problem continued.

I don't see any mention of geom or controller update in UPDATING but I
know they have been updated because I saw their revisions fly actross my
screen during the svn update. Also, I am running IR vers 16 on my
controllers, which is the latest version of LSI firmware.

Is there some new action I have to take to sucessfully boot LSI disks
against the updated kernel?


Can you try the mpslsi driver from LSI's web site and see if that works?

If it does, then it is a problem we've introduced locally.



I'll give it a shot but just to be clear, I have been running the 16
firmware for months.


The issue is very likely in the driver, not the firmware.  I'm just
trying to figure out whether it broke in LSI's Phase 16 or in our
additional changes in FreeBSD.

In any case, I've reproduced the problem, and hopefully I'll know soon
where the issue is.

So don't worry about trying LSI's driver.  Just go back to the previous
version of stable/9 that worked for you until we fix it.

This only affects RAID volumes, not regular disks.



Thanks.

I downloaded the mpslsi.ko driver from LSI under r255451 and the system 
now boots.


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Problems with stable/9 and LSI controlers?

2013-09-10 Thread Dennis Glatting



On Tue, 10 Sep 2013, John wrote:


On Tue, Sep 10, 2013 at 11:21:02AM -0700, Dennis Glatting wrote:


Today I updated several systems against stable/9 that had not bee updated
in ~five months. Two of the systems are serviced by LSI 2008 controllers
with a RAID1 array housing the operating system.

These systems no longer properly boot.

Specifically, they begin the boot process but bomb when they try to mount
root. Neither system sees the GPT partitions of the boot disk at the
mountroot prompt. On one system I replaced the hard disks,
repartitioned, and reinstalled but the problem continued.

I don't see any mention of geom or controller update in UPDATING but I
know they have been updated because I saw their revisions fly actross my
screen during the svn update. Also, I am running IR vers 16 on my
controllers, which is the latest version of LSI firmware.

Is there some new action I have to take to sucessfully boot LSI disks
against the updated kernel?


Hi, does it use the mfi driver? Because that has been updated. There was
an errata notice about it on the 22nd August concerning mfi in JBOD
mode and disks 2TB



(typing by hand)

mps0: LSI SAS2008 port 0xb-0xb0ff mem 
mps0: Firmware: 16.00.00.00, Driver: 16.00.00.00-fbsd
mps0: IOCCapabilities: 
185cScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,IR


The system I am sitting in front of, appears NOT to see the RAID1 disk but 
does see the two non-RAID disks. All disks are 1TB Seagate ST31000424SS.


The second system, which is remote and I cannot view its console from 
here, has two 250GB disks RAID1.



___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Problems with stable/9 and LSI controlers?

2013-09-10 Thread Dennis Glatting
Both servers work with this patch applied.




On Tue, 2013-09-10 at 14:29 -0600, Kenneth D. Merry wrote:
 On Tue, Sep 10, 2013 at 12:35:02 -0700, Dennis Glatting wrote:
  On Tue, 10 Sep 2013, Kenneth D. Merry wrote:
  On Tue, Sep 10, 2013 at 12:11:38 -0700, Dennis Glatting wrote:
  On Tue, 10 Sep 2013, Kenneth D. Merry wrote:
  
  On Tue, Sep 10, 2013 at 11:21:02 -0700, Dennis Glatting wrote:
  
  Today I updated several systems against stable/9 that had not bee 
  updated
  in ~five months. Two of the systems are serviced by LSI 2008 controllers
  with a RAID1 array housing the operating system.
  
  These systems no longer properly boot.
  
  Specifically, they begin the boot process but bomb when they try to 
  mount
  root. Neither system sees the GPT partitions of the boot disk at the
  mountroot prompt. On one system I replaced the hard disks,
  repartitioned, and reinstalled but the problem continued.
  
  I don't see any mention of geom or controller update in UPDATING but I
  know they have been updated because I saw their revisions fly actross my
  screen during the svn update. Also, I am running IR vers 16 on my
  controllers, which is the latest version of LSI firmware.
  
  Is there some new action I have to take to sucessfully boot LSI disks
  against the updated kernel?
  
  Can you try the mpslsi driver from LSI's web site and see if that works?
  
  If it does, then it is a problem we've introduced locally.
  
  
  I'll give it a shot but just to be clear, I have been running the 16
  firmware for months.
  
  The issue is very likely in the driver, not the firmware.  I'm just
  trying to figure out whether it broke in LSI's Phase 16 or in our
  additional changes in FreeBSD.
  
  In any case, I've reproduced the problem, and hopefully I'll know soon
  where the issue is.
  
  So don't worry about trying LSI's driver.  Just go back to the previous
  version of stable/9 that worked for you until we fix it.
  
  This only affects RAID volumes, not regular disks.
  
  
  Thanks.
  
  I downloaded the mpslsi.ko driver from LSI under r255451 and the system 
  now boots.
 
 Okay, try the attached patch with the new driver and see whether it fixes
 the problem for you.
 
 The issue was that with the new rescanning code, we weren't rescanning RAID
 volumes that got created.
 
 It fixes the problem for me with a RAID-1 volume.
 
 There is still the issue of all of the verbose probe errors that crop up
 when an Integrated RAID volume is enabled, but it isn't obvious at the
 moment whether we can easily fix that.
 
 Ken


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Tools to analyze syslog logs

2013-08-29 Thread Dennis Glatting
On Fri, 2013-08-30 at 11:33 +0700, Olivier Nicole wrote:
 Hello,
 
 What tool do you use to analyze syslog logs?
 
 All tools I can see in the ports seems to rely heavily on some big
 configuration file, that had tons of regexp to filter the event messages.
 
 I am wondering if some tool exists that would try to make a
 classification of the event messages; that one could use to say this
 type of message is close to that type of message hence thy should be
 treated the same way, etc.
 

Something similar was recently discussed on NANOG:

http://seclists.org/nanog/2013/Aug/530




___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Is this a memory error?

2013-07-06 Thread Dennis Glatting
Is this message indicating I have a memory error? I'm seeing this
message across two systems, one below:


FreeBSD mc 9.1-STABLE FreeBSD 9.1-STABLE #0 r252678: Thu Jul  4 03:47:52
PDT 2013 root@mc:/usr/obj/disk-1/src/sys/SMUNI  amd64


Jul  4 15:11:10 mc kernel: MCA: Bank 2, Status 0x981a400c0176
Jul  4 15:11:10 mc kernel: MCA: Global Cap 0x0107, Status
0x
Jul  4 15:11:10 mc kernel: MCA: Vendor AuthenticAMD, ID 0x600f12, APIC
ID 72
Jul  4 15:11:10 mc kernel: MCA: CPU 24 COR DCACHE L2 EVICT error
Jul  4 15:11:10 mc kernel: MCA: Misc 0x0


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: More than 32 CPUs under 8.4-P

2013-05-19 Thread Dennis Glatting
On Sun, 2013-05-19 at 11:48 +0200, Tijl Coosemans wrote:
 On 2013-05-18 19:13, Dennis Glatting wrote:
  I have a 4x16=64 core server running FreeBSD 8.4-P but only two of the
  CPUs (2x16=32) are enabled. Enabling the other 32 isn't as simple as
  changing MAXCPU in param.h (apparently) and recompiling.
  
  What do I need to do to enable the other 32 cores?
 
 Try FreeBSD 9.x. MAXCPU is 64 there.
 

Not an option. 

ZFS hangs on multi-socket systems (Tyan, Supermicro) under 9.1. ZFS does
not hang under 8.4. This (and one other 4 socket) is a production
system.







___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: More than 32 CPUs under 8.4-P

2013-05-19 Thread Dennis Glatting
On Sun, 2013-05-19 at 16:28 -0400, Paul Kraus wrote:
 On May 19, 2013, at 11:51 AM, Dennis Glatting free...@pki2.com wrote:
 
  ZFS hangs on multi-socket systems (Tyan, Supermicro) under 9.1. ZFS does
  not hang under 8.4. This (and one other 4 socket) is a production
  system.
 
   Can you be more specific, I have been running 9.0 and 9.1 systems with
 multi-CPU and all ZFS with no (CPU related*) issues.
 

I have (down to) ten FreeBSD/ZFS systems. Five of them are multi-socket
populated. All are AMD CPUs of the 6200 series. Two of those
multi-socketed systems are simply workstations and don't do much file
I/O, so I have yet to see them fault.

The remaining three perform significant I/O in the 1-8TB (simultaneous)
file range, including sorting, compression, backup, etc (ZFS compression
is enabled on some data sets as is dedup on a few minor data sets). I
also do iSCSI and NFS from one of these systems.

Simply, if I run 9.1 on those three busy systems ZFS will eventually
hang under load (within ten hours to a few days) whereas it does not
under 8.3/4. Two of those systems are 4x16 cores, one 2x16, and two 2x8
cores. Multiple, simultaneous pbzip2 runs on individual 2-5TB ASCII
files generally causes a hang within 10-20 hours.

Hang means the system is alive and on the network but disk I/O has
stopped. Run any command except statically linked executables on a
memory volume and they will not run (no output or return to command
prompt). This includes reboot, which never really reboots.

The volumes where work is performed are typically 12-33TB RAIDz2
volumes. For example:

root@mc:~ # zpool list disk-1
NAME SIZE  ALLOC   FREECAP  DEDUP  HEALTH  ALTROOT
disk-1  16.2T  5.86T  10.4T36%  1.32x  ONLINE  -

root@mc:~ # zpool status disk-1
  pool: disk-1
 state: ONLINE
  scan: scrub repaired 0 in 21h53m with 0 errors on Mon Apr 29 01:52:55
2013
config:

NAMESTATE READ WRITE CKSUM
disk-1  ONLINE   0 0 0
  raidz2-0  ONLINE   0 0 0
da2 ONLINE   0 0 0
da3 ONLINE   0 0 0
da4 ONLINE   0 0 0
da7 ONLINE   0 0 0
da5 ONLINE   0 0 0
da6 ONLINE   0 0 0
cache
  da0   ONLINE   0 0 0

errors: No known data errors


 * I say no CPU related issues because I have run into SATA timeout
 issues with an external SATA enclosure with 4 drives (I know, SATA port
 expanders are evil, but it is my best option here). Sometimes the zpool
 hangs hard, sometimes just becomes unresponsive for a while. My fix,
 such as it is, is to tune the zfs per vdev queue depth as follows:
 
 vfs.zfs.vdev.min_pending=3
 vfs.zfs.vdev.max_pending=5
 

I've not tried those. Currently, these are mine:

vfs.zfs.write_limit_override=1G
vfs.zfs.arc_max=8G
vfs.zfs.txg.timeout=15
vfs.zfs.cache_flush_disable=1

# Recommended from the net
# April, 2013
vfs.zfs.l2arc_norw=0# Default is 1
vfs.zfs.l2arc_feed_again=0  # Default is 1
vfs.zfs.l2arc_noprefetch=0  # Default is 0
vfs.zfs.l2arc_feed_min_ms=1000  # Default is 200


 The defaults are 5 and 10 respectively, and when I run with those I
 have the timeout issues, but only under very heavy I/O load. I only
 generate such load when migrating large amounts of data, which
 thankfully does not happen all that often.
 

Two days ago when the 9.1 system hanged I was able to run a static
procstat where it inadvertently(?) printed that da0 wasn't responsive on
the console. Unfortunately I didn't have a static camcontrol ready so I
was unable to query it.

That said, according to the criteria from
https://wiki.freebsd.org/AvgZfsDeadlockDebug that hang isn't a true ZFS
problem, yet hung it was.

I have since (today) updated the firmware of most of the devices in that
system and it is currently running some tasks. Most of the disks in that
system are Seagate but the un-updated devices include three WD disks
(RAID1 OS and a swap disk) -- unupdated because I haven't been able to
figure WD firmware download out) and a SSD where the manufacturer
indicates the firmware diff is minor, though I plan to go back and flash
it anyway.

If my 4x16 system ever finishes I will be updating its device's firmware
too but it is an 8.4-P system and doesn't give me any trouble. Another
4x16 system gave me ZFS trouble under 9.1 but when I downgraded to 8.4-P
it has been stable as a rock for the past 22 days often under heavy
load.





___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: More than 32 CPUs under 8.4-P

2013-05-19 Thread Dennis Glatting

Minutes after I typed that message 2x16 the system paniced with the
following back trace:

kdb_backtrace
panic
vdev_deadman
vdev_deadman
vdev_deadman
spa_deadman
softclock
intr_event_execute_handlers
ithread_loop
fork_exit
fork_trampoline

I had just created a memory disk when that happened:

root@iirc:~ # mdconfig -a -t swap -s 1g -u 1
root@iirc:~ # newfs -U /dev/md1
root@iirc:~ # mount /dev/md1 /mnt
root@iirc:~ # cp -p procstat kgdb /mnt
root@iirc:~ # cd /rescue/
root@iirc:/rescue # cp -p * /mnt







On Sun, 2013-05-19 at 18:45 -0700, Dennis Glatting wrote:
 On Sun, 2013-05-19 at 16:28 -0400, Paul Kraus wrote:
  On May 19, 2013, at 11:51 AM, Dennis Glatting free...@pki2.com wrote:
  
   ZFS hangs on multi-socket systems (Tyan, Supermicro) under 9.1. ZFS does
   not hang under 8.4. This (and one other 4 socket) is a production
   system.
  
  Can you be more specific, I have been running 9.0 and 9.1 systems with
  multi-CPU and all ZFS with no (CPU related*) issues.
  
 
 I have (down to) ten FreeBSD/ZFS systems. Five of them are multi-socket
 populated. All are AMD CPUs of the 6200 series. Two of those
 multi-socketed systems are simply workstations and don't do much file
 I/O, so I have yet to see them fault.
 
 The remaining three perform significant I/O in the 1-8TB (simultaneous)
 file range, including sorting, compression, backup, etc (ZFS compression
 is enabled on some data sets as is dedup on a few minor data sets). I
 also do iSCSI and NFS from one of these systems.
 
 Simply, if I run 9.1 on those three busy systems ZFS will eventually
 hang under load (within ten hours to a few days) whereas it does not
 under 8.3/4. Two of those systems are 4x16 cores, one 2x16, and two 2x8
 cores. Multiple, simultaneous pbzip2 runs on individual 2-5TB ASCII
 files generally causes a hang within 10-20 hours.
 
 Hang means the system is alive and on the network but disk I/O has
 stopped. Run any command except statically linked executables on a
 memory volume and they will not run (no output or return to command
 prompt). This includes reboot, which never really reboots.
 
 The volumes where work is performed are typically 12-33TB RAIDz2
 volumes. For example:
 
 root@mc:~ # zpool list disk-1
 NAME SIZE  ALLOC   FREECAP  DEDUP  HEALTH  ALTROOT
 disk-1  16.2T  5.86T  10.4T36%  1.32x  ONLINE  -
 
 root@mc:~ # zpool status disk-1
   pool: disk-1
  state: ONLINE
   scan: scrub repaired 0 in 21h53m with 0 errors on Mon Apr 29 01:52:55
 2013
 config:
 
   NAMESTATE READ WRITE CKSUM
   disk-1  ONLINE   0 0 0
 raidz2-0  ONLINE   0 0 0
   da2 ONLINE   0 0 0
   da3 ONLINE   0 0 0
   da4 ONLINE   0 0 0
   da7 ONLINE   0 0 0
   da5 ONLINE   0 0 0
   da6 ONLINE   0 0 0
   cache
 da0   ONLINE   0 0 0
 
 errors: No known data errors
 
 
  * I say no CPU related issues because I have run into SATA timeout
  issues with an external SATA enclosure with 4 drives (I know, SATA port
  expanders are evil, but it is my best option here). Sometimes the zpool
  hangs hard, sometimes just becomes unresponsive for a while. My fix,
  such as it is, is to tune the zfs per vdev queue depth as follows:
  
  vfs.zfs.vdev.min_pending=3
  vfs.zfs.vdev.max_pending=5
  
 
 I've not tried those. Currently, these are mine:
 
 vfs.zfs.write_limit_override=1G
 vfs.zfs.arc_max=8G
 vfs.zfs.txg.timeout=15
 vfs.zfs.cache_flush_disable=1
 
 # Recommended from the net
 # April, 2013
 vfs.zfs.l2arc_norw=0  # Default is 1
 vfs.zfs.l2arc_feed_again=0# Default is 1
 vfs.zfs.l2arc_noprefetch=0# Default is 0
 vfs.zfs.l2arc_feed_min_ms=1000# Default is 200
 
 
  The defaults are 5 and 10 respectively, and when I run with those I
  have the timeout issues, but only under very heavy I/O load. I only
  generate such load when migrating large amounts of data, which
  thankfully does not happen all that often.
  
 
 Two days ago when the 9.1 system hanged I was able to run a static
 procstat where it inadvertently(?) printed that da0 wasn't responsive on
 the console. Unfortunately I didn't have a static camcontrol ready so I
 was unable to query it.
 
 That said, according to the criteria from
 https://wiki.freebsd.org/AvgZfsDeadlockDebug that hang isn't a true ZFS
 problem, yet hung it was.
 
 I have since (today) updated the firmware of most of the devices in that
 system and it is currently running some tasks. Most of the disks in that
 system are Seagate but the un-updated devices include three WD disks
 (RAID1 OS and a swap disk) -- unupdated because I haven't been able to
 figure WD firmware download out) and a SSD where the manufacturer
 indicates the firmware diff is minor, though I plan to go back and flash
 it anyway.
 
 If my 4x16 system ever finishes I

Graphics card differences between CentOS and FBSD (multi monitor)?

2013-05-18 Thread Dennis Glatting
I have a graphics card that behaves differently under CentOS 6.4 and
FreeBSD 9.1. Specifically, it is an older card (Spapphire with a ATI
chip set) where I have a multi-monitor set up but under CentOS the
monitors come up as expected but under FreeBSD there is some kind of
weird video-line overlap across the monitors.

As far as I can tell the xorg.conf is similar but the X code under
CentOS is versions ahead of FBSD even with WITH_NEW_XORG defined but I
suspect that isn't the real problem though hand patching the code does
have some impact. It also appears the FBSD kernel is lacking in some
areas but I'm unsure (and doubt) that is the real problem.

What should I be looking at in terms of configuration/code/etc such that
multi-monitor behave as expected under FBSD?

Also, I need to update some cards and I'm looking for a up-to-date card
that supports multi-monitor under FreeBSD. Most of my cards are old but
work well however I now have purchasing criteria (i.e., have to
purchase new and from a supported supplier, not used from Amazon or
eBay). Any recommended multi-monitor card you know works?




___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


More than 32 CPUs under 8.4-P

2013-05-18 Thread Dennis Glatting

I have a 4x16=64 core server running FreeBSD 8.4-P but only two of the
CPUs (2x16=32) are enabled. Enabling the other 32 isn't as simple as
changing MAXCPU in param.h (apparently) and recompiling.

What do I need to do to enable the other 32 cores?


Copyright (c) 1992-2013 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights
reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.4-PRERELEASE #0 r250401: Wed May  8 21:46:23 PDT 2013
root@mc:/disk-2/obj/disk-1/src/sys/GENERIC amd64
gcc version 4.2.1 20070831 patched [FreeBSD]
Timecounter i8254 frequency 1193182 Hz quality 0
CPU: AMD Opteron(TM) Processor 6274  (2200.04-MHz
K8-class CPU)
  Origin = AuthenticAMD  Id = 0x600f12  Family = 15  Model = 1
Stepping = 2

Features=0x178bfbffFPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT

Features2=0x1e98220bSSE3,PCLMULQDQ,MON,SSSE3,CX16,SSE4.1,SSE4.2,POPCNT,AESNI,XSAVE,OSXSAVE,AVX
  AMD Features=0x2e500800SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM
  AMD
Features2=0x1c9bfffLAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,XOP,SKINIT,WDT,LWP,FMA4,NodeId,Topology,b23,b24
  TSC: P-state invariant
real memory  = 137438953472 (131072 MB)
avail memory = 132427862016 (126293 MB)
ACPI APIC Table: 120911 APIC1027
FreeBSD/SMP: Multiprocessor System Detected: 32 CPUs
FreeBSD/SMP: 2 package(s) x 16 core(s)


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: More than 32 CPUs under 8.4-P

2013-05-18 Thread Dennis Glatting
On Sat, 2013-05-18 at 20:24 +0300, Ivan Klymenko wrote:
 В Sat, 18 May 2013 10:13:08 -0700
 Dennis Glatting free...@pki2.com пишет:
 
  
  I have a 4x16=64 core server running FreeBSD 8.4-P but only two of the
  CPUs (2x16=32) are enabled. Enabling the other 32 isn't as simple as
  changing MAXCPU in param.h (apparently) and recompiling.
 
 Oops, sorry :)
 

In the boot sequence the kernel (loop) kept printing errors to the
console and didn't get to a command prompt.




___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

pid 916 (tcsh): sigreturn set_fpcontext err 22

2013-05-09 Thread Dennis Glatting
I am seeing this error after a svn update (today) under 9.1 and under
CURRENT. Unfortunately I cannot login (even from the console) to scarf
off dmesg.boot but I found the path to correcting the problem is to boot
the old kernel.

Specifically, with the failed kernel I can boot to single user mode
without a problem but after the system goes multi-user all my commands
core dump with the subject error. In single user mode I simply restore
the old kernel (i.e., mv kernel.old) and all is well.

The following is the dmesg.boot from the failed kernel when booting to
single user mode.

Any clue?





root@rotfl:~ # cat dmesg.boot 
Copyright (c) 1992-2013 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 10.0-CURRENT #0 r250401: Wed May  8 22:21:12 PDT 2013
root@rotfl:/usr/obj/disk-1/src/sys/GENERIC amd64
FreeBSD clang version 3.3 (trunk 178860) 20130405
WARNING: WITNESS option enabled, expect reduced performance.
CPU: AMD Opteron(TM) Processor 6272  (2100.04-MHz
K8-class CPU)
  Origin = AuthenticAMD  Id = 0x600f12  Family = 0x15  Model = 0x1
Stepping = 2

Features=0x178bfbffFPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT

Features2=0x1e98220bSSE3,PCLMULQDQ,MON,SSSE3,CX16,SSE4.1,SSE4.2,POPCNT,AESNI,XSAVE,OSXSAVE,AVX
  AMD Features=0x2e500800SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM
  AMD
Features2=0x1c9bfffLAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,XOP,SKINIT,WDT,LWP,FMA4,NodeId,Topology,b23,b24
  TSC: P-state invariant, performance statistics
real memory  = 34359738368 (32768 MB)
avail memory = 31976153088 (30494 MB)
Event timer LAPIC quality 400
ACPI APIC Table: 052412 APIC0723
FreeBSD/SMP: Multiprocessor System Detected: 16 CPUs
FreeBSD/SMP: 1 package(s) x 16 core(s)
 cpu0 (BSP): APIC ID: 32
 cpu1 (AP): APIC ID: 33
 cpu2 (AP): APIC ID: 34
 cpu3 (AP): APIC ID: 35
 cpu4 (AP): APIC ID: 36
 cpu5 (AP): APIC ID: 37
 cpu6 (AP): APIC ID: 38
 cpu7 (AP): APIC ID: 39
 cpu8 (AP): APIC ID: 40
 cpu9 (AP): APIC ID: 41
 cpu10 (AP): APIC ID: 42
 cpu11 (AP): APIC ID: 43
 cpu12 (AP): APIC ID: 44
 cpu13 (AP): APIC ID: 45
 cpu14 (AP): APIC ID: 46
 cpu15 (AP): APIC ID: 47
ioapic0 Version 2.1 irqs 0-23 on motherboard
kbd1 at kbdmux0
acpi0: SMCI  on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of fec0, 1403f00 (3) failed
cpu0: ACPI CPU on acpi0
cpu1: ACPI CPU on acpi0
cpu2: ACPI CPU on acpi0
cpu3: ACPI CPU on acpi0
cpu4: ACPI CPU on acpi0
cpu5: ACPI CPU on acpi0
cpu6: ACPI CPU on acpi0
cpu7: ACPI CPU on acpi0
cpu8: ACPI CPU on acpi0
cpu9: ACPI CPU on acpi0
cpu10: ACPI CPU on acpi0
cpu11: ACPI CPU on acpi0
cpu12: ACPI CPU on acpi0
cpu13: ACPI CPU on acpi0
cpu14: ACPI CPU on acpi0
cpu15: ACPI CPU on acpi0
attimer0: AT timer port 0x40-0x43 irq 0 on acpi0
Timecounter i8254 frequency 1193182 Hz quality 0
Event timer i8254 frequency 1193182 Hz quality 100
atrtc0: AT realtime clock port 0x70-0x71 irq 8 on acpi0
Event timer RTC frequency 32768 Hz quality 0
hpet0: High Precision Event Timer iomem 0xfed0-0xfed003ff on acpi0
Timecounter HPET frequency 14318180 Hz quality 950
Timecounter ACPI-safe frequency 3579545 Hz quality 850
acpi_timer0: 24-bit timer at 3.579545MHz port 0x808-0x80b on acpi0
pcib0: ACPI Host-PCI bridge port 0xcf8-0xcff iomem
0xfed4-0xfed44fff on acpi0
pci0: ACPI PCI bus on pcib0
pcib1: ACPI PCI-PCI bridge irq 18 at device 2.0 on pci0
pci5: ACPI PCI bus on pcib1
mps0: LSI SAS2008 port 0xe000-0xe0ff mem
0xdff3c000-0xdff3,0xdff4-0xdff7 irq 18 at device 0.0 on pci5
mps0: Firmware: 14.00.00.00, Driver: 14.00.00.02-fbsd
mps0: IOCCapabilities:
1285cScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc
pcib2: ACPI PCI-PCI bridge irq 16 at device 4.0 on pci0
pci4: ACPI PCI bus on pcib2
mps1: LSI SAS2008 port 0xd000-0xd0ff mem
0xdfe3c000-0xdfe3,0xdfe4-0xdfe7 irq 16 at device 0.0 on pci4
mps1: Firmware: 14.00.00.00, Driver: 14.00.00.02-fbsd
mps1: IOCCapabilities:
185cScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,IR
pcib3: ACPI PCI-PCI bridge irq 16 at device 12.0 on pci0
pci3: ACPI PCI bus on pcib3
mps2: LSI SAS2008 port 0xc000-0xc0ff mem
0xdfd3c000-0xdfd3,0xdfd4-0xdfd7 irq 16 at device 0.0 on pci3
mps2: Firmware: 14.00.00.00, Driver: 14.00.00.02-fbsd
mps2: IOCCapabilities:
1285cScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc
pcib4: ACPI PCI-PCI bridge irq 17 at device 13.0 on pci0
pci2: ACPI PCI bus on pcib4
igb0: Intel(R) PRO/1000 Network Connection version - 2.3.10 port
0xb800-0xb81f mem
0xdfce-0xdfcf,0xdfcc-0xdfcd,0xdfc9c000-0xdfc9 irq 17
at device 0.0 on pci2
igb0: Using MSIX interrupts with 9 vectors
igb0: Ethernet address: 00:25:90:78:8b:7e
igb0: Bound queue 0 to cpu 0
igb0: Bound queue 1 to cpu 1
igb0: Bound queue 2 to cpu 2
igb0: Bound queue 3 

SMP boot differences between 8.4 and 9.1?

2013-04-27 Thread Dennis Glatting

I have two four socket Opteron 6200 motherboards with populated 16-core
Opteron 6200 series processors. Onw is Tyan (below) and the other
Supermicro.

When booted under 8.4 only two sockets are recognized but four under
9.1. Is this expected behavior?

dmesg from 8.4:

mc# cat /var/run/dmesg.boot 
Copyright (c) 1992-2013 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.4-PRERELEASE #0 r249529: Mon Apr 15 19:26:38 PDT 2013
root@mc:/disk-2/obj/disk-1/src/sys/SMUNI.RELENG_8 amd64
gcc version 4.2.1 20070831 patched [FreeBSD]
Timecounter i8254 frequency 1193182 Hz quality 0
CPU: AMD Opteron(TM) Processor 6274  (2200.04-MHz
K8-class CPU)
  Origin = AuthenticAMD  Id = 0x600f12  Family = 15  Model = 1
Stepping = 2

Features=0x178bfbffFPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT

Features2=0x1e98220bSSE3,PCLMULQDQ,MON,SSSE3,CX16,SSE4.1,SSE4.2,POPCNT,AESNI,XSAVE,OSXSAVE,AVX
  AMD Features=0x2e500800SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM
  AMD
Features2=0x1c9bfffLAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,XOP,SKINIT,WDT,LWP,FMA4,NodeId,Topology,b23,b24
  TSC: P-state invariant
real memory  = 137438953472 (131072 MB)
avail memory = 132427870208 (126293 MB)
ACPI APIC Table: 120911 APIC1027
FreeBSD/SMP: Multiprocessor System Detected: 32 CPUs
FreeBSD/SMP: 2 package(s) x 16 core(s)
 cpu0 (BSP): APIC ID: 32
 cpu1 (AP): APIC ID: 33
 cpu2 (AP): APIC ID: 34
 cpu3 (AP): APIC ID: 35
 cpu4 (AP): APIC ID: 36
 cpu5 (AP): APIC ID: 37
 cpu6 (AP): APIC ID: 38
 cpu7 (AP): APIC ID: 39
 cpu8 (AP): APIC ID: 40
 cpu9 (AP): APIC ID: 41
 cpu10 (AP): APIC ID: 42
 cpu11 (AP): APIC ID: 43
 cpu12 (AP): APIC ID: 44
 cpu13 (AP): APIC ID: 45
 cpu14 (AP): APIC ID: 46
 cpu15 (AP): APIC ID: 47
 cpu16 (AP): APIC ID: 64
 cpu17 (AP): APIC ID: 65
 cpu18 (AP): APIC ID: 66
 cpu19 (AP): APIC ID: 67
 cpu20 (AP): APIC ID: 68
 cpu21 (AP): APIC ID: 69
 cpu22 (AP): APIC ID: 70
 cpu23 (AP): APIC ID: 71
 cpu24 (AP): APIC ID: 72
 cpu25 (AP): APIC ID: 73
 cpu26 (AP): APIC ID: 74
 cpu27 (AP): APIC ID: 75
 cpu28 (AP): APIC ID: 76
 cpu29 (AP): APIC ID: 77
 cpu30 (AP): APIC ID: 78
 cpu31 (AP): APIC ID: 79
  cpu (AP): APIC ID: 96 (disabled)
  cpu (AP): APIC ID: 97 (disabled)
  cpu (AP): APIC ID: 98 (disabled)
  cpu (AP): APIC ID: 99 (disabled)
  cpu (AP): APIC ID: 100 (disabled)
  cpu (AP): APIC ID: 101 (disabled)
  cpu (AP): APIC ID: 102 (disabled)
  cpu (AP): APIC ID: 103 (disabled)
  cpu (AP): APIC ID: 104 (disabled)
  cpu (AP): APIC ID: 105 (disabled)
  cpu (AP): APIC ID: 106 (disabled)
  cpu (AP): APIC ID: 107 (disabled)
  cpu (AP): APIC ID: 108 (disabled)
  cpu (AP): APIC ID: 109 (disabled)
  cpu (AP): APIC ID: 110 (disabled)
  cpu (AP): APIC ID: 111 (disabled)
  cpu (AP): APIC ID: 128 (disabled)
  cpu (AP): APIC ID: 129 (disabled)
  cpu (AP): APIC ID: 130 (disabled)
  cpu (AP): APIC ID: 131 (disabled)
  cpu (AP): APIC ID: 132 (disabled)
  cpu (AP): APIC ID: 133 (disabled)
  cpu (AP): APIC ID: 134 (disabled)
  cpu (AP): APIC ID: 135 (disabled)
  cpu (AP): APIC ID: 136 (disabled)
  cpu (AP): APIC ID: 137 (disabled)
  cpu (AP): APIC ID: 138 (disabled)
  cpu (AP): APIC ID: 139 (disabled)
  cpu (AP): APIC ID: 140 (disabled)
  cpu (AP): APIC ID: 141 (disabled)
  cpu (AP): APIC ID: 142 (disabled)
  cpu (AP): APIC ID: 143 (disabled)
ACPI Warning: Optional field Pm2ControlBlock has zero address or length:
0x/0x1 (20101013/tbfadt-655)
ioapic0 Version 2.1 irqs 0-23 on motherboard
ioapic1 Version 2.1 irqs 24-55 on motherboard
kbd1 at kbdmux0
cryptosoft0: software crypto on motherboard
aesni0: AES-CBC,AES-XTS on motherboard
acpi0: 120911 XSDT1027 on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of fec0, 1000 (3) failed
acpi0: reservation of fee0, 1000 (3) failed
acpi0: reservation of ffb8, 8 (3) failed
acpi0: reservation of fec1, 20 (3) failed
acpi0: reservation of 0, a (3) failed
acpi0: reservation of 10, dff0 (3) failed
Timecounter ACPI-safe frequency 3579545 Hz quality 850
acpi_timer0: 32-bit timer at 3.579545MHz port 0x808-0x80b on acpi0
cpu0: ACPI CPU on acpi0
cpu1: ACPI CPU on acpi0
cpu2: ACPI CPU on acpi0
cpu3: ACPI CPU on acpi0
cpu4: ACPI CPU on acpi0
cpu5: ACPI CPU on acpi0
cpu6: ACPI CPU on acpi0
cpu7: ACPI CPU on acpi0
cpu8: ACPI CPU on acpi0
cpu9: ACPI CPU on acpi0
cpu10: ACPI CPU on acpi0
cpu11: ACPI CPU on acpi0
cpu12: ACPI CPU on acpi0
cpu13: ACPI CPU on acpi0
cpu14: ACPI CPU on acpi0
cpu15: ACPI CPU on acpi0
cpu16: ACPI CPU on acpi0
cpu17: ACPI CPU on acpi0
cpu18: ACPI CPU on acpi0
cpu19: ACPI CPU on acpi0
cpu20: ACPI CPU on acpi0
cpu21: ACPI CPU on acpi0
cpu22: ACPI CPU on acpi0
cpu23: ACPI CPU on acpi0
cpu24: ACPI CPU on acpi0
cpu25: ACPI CPU on acpi0
cpu26: ACPI CPU on acpi0
cpu27: ACPI CPU on acpi0

Re: SMP boot differences between 8.4 and 9.1?

2013-04-27 Thread Dennis Glatting
On Sun, 2013-04-28 at 07:24 +0700, Erich Dollansky wrote:
 Hi,
 
 On Sat, 27 Apr 2013 08:29:04 -0700
 Dennis Glatting free...@pki2.com wrote:
 
  
  I have two four socket Opteron 6200 motherboards with populated
  16-core Opteron 6200 series processors. Onw is Tyan (below) and the
  other Supermicro.
 
 nice machines.
  
  When booted under 8.4 only two sockets are recognized but four under
  9.1. Is this expected behavior?
  
 they are recognised but disabled. Is this the generic kernel?
 

Yes.




___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


LSI 2008 Contoller settings for ZFS?

2013-04-24 Thread Dennis Glatting


Is there a recommended set of settings on LSI 2008 chips burned IT for 
ZFS?


Looking at the Global Settings in the configuration utility there is a 
field labeled status whose value can be enabled/disable/error. I don't 
know what to put there or whether it matters.


There are other configuration items across the controller. Other than 
boot order, I don't know if they matter but I/O Timeout for Block 
Devices might.


Any recommendation?


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Is the Intel X520-SR2 (82599ES) supported by the ixbe driver?

2013-03-15 Thread Dennis Glatting


I have a new Intel X520-SR2 that I plopped into my Supermicro H8QGL-6F 
with the hope I could connect 10GbE to a Cisco 3560. The links come but 
but there is much wierdness. Looking through the driver I see the 82599EB 
is supported but no mention of the ES.


Should this work?

I have:

Keystone# uname -a
FreeBSD Keystone 9.1-STABLE FreeBSD 9.1-STABLE #0 r248293: Thu Mar 14 
19:31:29 PDT 2013 root@Keystone:/usr/obj/disk-3/src/sys/SECRACK  amd64



Keystone# dmesg | egrep 'ix[01]'
ix0: Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.5.7 - 
STABLE/9 port 0x8400-0x841f mem 
0xdce8-0xdcef,0xdce7c000-0xdce7 irq 32 at device 0.0 on pci3

ix0: Using MSIX interrupts with 9 vectors
ix0: Ethernet address: 90:e2:ba:2f:5f:9c
ix0: PCI Express Bus: Speed 5.0Gb/s Width x8
ix1: Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.5.7 - 
STABLE/9 port 0x8800-0x881f mem 
0xdcf8-0xdcff,0xdcf7c000-0xdcf7 irq 33 at device 0.1 on pci3

ix1: Using MSIX interrupts with 9 vectors
ix1: Ethernet address: 90:e2:ba:2f:5f:9d
ix1: PCI Express Bus: Speed 5.0Gb/s Width x8
ix0: link state changed to UP


Keystone# ifconfig ix0
ix0: flags=8843UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST metric 0 mtu 8192

options=407bbRXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO
ether 90:e2:ba:2f:5f:9c
nd6 options=29PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL
media: Ethernet autoselect (10Gbase-SR full-duplex)
status: active


Here's an interesting point. If I set the address for the interface, it is 
accepted but an ifconfig of the interface is shown above. Specifically, I 
previously executed this command:


Keystone# ifconfig ix0 inet 192.168.3.2/24 mtu 8192 up


Executing that command a second time yields:

Keystone# ifconfig ix0 inet 192.168.3.2/24 mtu 8192 up
ifconfig: ioctl (SIOCAIFADDR): File exists


A truss of that command yields more interesting things, specifically:

kldload(if_ix) ERR#2 'No such file or 
directory'


There is no driver named if_ix. It is also weird that the interface is 
named ix0 rather than ixgbe0.



Also, an arp shows:

Keystone# arp -an
? (192.168.17.1) at 2c:21:72:cb:f5:0c on vlan17 expires in 166 seconds 
[vlan]
? (192.168.13.33) at 78:e7:d1:ea:7a:4e on vlan13 expires in 760 seconds 
[vlan]
? (192.168.13.1) at 2c:21:72:cb:f5:0c on vlan13 expires in 97 seconds 
[vlan]
? (192.168.13.3) at 00:21:d8:0b:57:98 on vlan13 expires in 232 seconds 
[vlan]
? (192.168.7.6) at dc:7b:94:9a:52:41 on vlan7 expires in 268 seconds 
[vlan]
? (192.168.7.4) at e0:2f:6d:30:39:41 on vlan7 expires in 290 seconds 
[vlan]
? (192.168.7.3) at 00:21:d8:0b:57:98 on vlan7 expires in 210 seconds 
[vlan]
? (192.168.7.66) at 28:92:4a:2e:e0:a0 on vlan7 expires in 1199 seconds 
[vlan]
? (192.168.7.33) at 78:e7:d1:ea:7a:4e on vlan7 expires in 143 seconds 
[vlan]
? (192.168.7.65) at 28:92:4a:2e:eb:22 on vlan7 expires in 615 seconds 
[vlan]

? (192.168.3.2) at 90:e2:ba:2f:5f:9c on ix0 permanent [ethernet]


So clearly there is a MAC/IP association however I cannot ping the IP:


Keystone# ping 192.168.3.2
PING 192.168.3.2 (192.168.3.2): 56 data bytes
(nothing)


Can someone clue me in?




___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


RE: Is the Intel X520-SR2 (82599ES) supported by the ixbe driver?

2013-03-15 Thread Dennis Glatting



On Fri, 15 Mar 2013, Teske, Devin wrote:


I suspect you're running out of mbuf clusters.

Try:

echo kern.ipc.nmbclusters=524288  /etc/sysctl.conf
echo kern.ipc.nmbjumbop=524288  /etc/sysctl.conf
reboot


These were my settings:

Keystone sysctl -a kern.ipc.nmbclusters
kern.ipc.nmbclusters: 1048576

Keystone sysctl -a kern.ipc.nmbjumbop
kern.ipc.nmbjumbop: 524288




--
Devin


From: owner-freebsd-questi...@freebsd.org [owner-freebsd-questi...@freebsd.org] 
on behalf of Dennis Glatting [d...@pki2.com]
Sent: Friday, March 15, 2013 10:17 AM
To: freebsd-questions@freebsd.org
Subject: Is the Intel X520-SR2 (82599ES) supported by the ixbe driver?

I have a new Intel X520-SR2 that I plopped into my Supermicro H8QGL-6F
with the hope I could connect 10GbE to a Cisco 3560. The links come but
but there is much wierdness. Looking through the driver I see the 82599EB
is supported but no mention of the ES.

Should this work?

I have:

Keystone# uname -a
FreeBSD Keystone 9.1-STABLE FreeBSD 9.1-STABLE #0 r248293: Thu Mar 14
19:31:29 PDT 2013 root@Keystone:/usr/obj/disk-3/src/sys/SECRACK  amd64


Keystone# dmesg | egrep 'ix[01]'
ix0: Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.5.7 -
STABLE/9 port 0x8400-0x841f mem
0xdce8-0xdcef,0xdce7c000-0xdce7 irq 32 at device 0.0 on pci3
ix0: Using MSIX interrupts with 9 vectors
ix0: Ethernet address: 90:e2:ba:2f:5f:9c
ix0: PCI Express Bus: Speed 5.0Gb/s Width x8
ix1: Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.5.7 -
STABLE/9 port 0x8800-0x881f mem
0xdcf8-0xdcff,0xdcf7c000-0xdcf7 irq 33 at device 0.1 on pci3
ix1: Using MSIX interrupts with 9 vectors
ix1: Ethernet address: 90:e2:ba:2f:5f:9d
ix1: PCI Express Bus: Speed 5.0Gb/s Width x8
ix0: link state changed to UP


Keystone# ifconfig ix0
ix0: flags=8843UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST metric 0 mtu 8192

options=407bbRXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO
ether 90:e2:ba:2f:5f:9c
nd6 options=29PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL
media: Ethernet autoselect (10Gbase-SR full-duplex)
status: active


Here's an interesting point. If I set the address for the interface, it is
accepted but an ifconfig of the interface is shown above. Specifically, I
previously executed this command:

Keystone# ifconfig ix0 inet 192.168.3.2/24 mtu 8192 up


Executing that command a second time yields:

Keystone# ifconfig ix0 inet 192.168.3.2/24 mtu 8192 up
ifconfig: ioctl (SIOCAIFADDR): File exists


A truss of that command yields more interesting things, specifically:

kldload(if_ix) ERR#2 'No such file or 
directory'


There is no driver named if_ix. It is also weird that the interface is
named ix0 rather than ixgbe0.


Also, an arp shows:

Keystone# arp -an
? (192.168.17.1) at 2c:21:72:cb:f5:0c on vlan17 expires in 166 seconds
[vlan]
? (192.168.13.33) at 78:e7:d1:ea:7a:4e on vlan13 expires in 760 seconds
[vlan]
? (192.168.13.1) at 2c:21:72:cb:f5:0c on vlan13 expires in 97 seconds
[vlan]
? (192.168.13.3) at 00:21:d8:0b:57:98 on vlan13 expires in 232 seconds
[vlan]
? (192.168.7.6) at dc:7b:94:9a:52:41 on vlan7 expires in 268 seconds
[vlan]
? (192.168.7.4) at e0:2f:6d:30:39:41 on vlan7 expires in 290 seconds
[vlan]
? (192.168.7.3) at 00:21:d8:0b:57:98 on vlan7 expires in 210 seconds
[vlan]
? (192.168.7.66) at 28:92:4a:2e:e0:a0 on vlan7 expires in 1199 seconds
[vlan]
? (192.168.7.33) at 78:e7:d1:ea:7a:4e on vlan7 expires in 143 seconds
[vlan]
? (192.168.7.65) at 28:92:4a:2e:eb:22 on vlan7 expires in 615 seconds
[vlan]
? (192.168.3.2) at 90:e2:ba:2f:5f:9c on ix0 permanent [ethernet]


So clearly there is a MAC/IP association however I cannot ping the IP:


Keystone# ping 192.168.3.2
PING 192.168.3.2 (192.168.3.2): 56 data bytes
(nothing)


Can someone clue me in?




___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

_
The information contained in this message is proprietary and/or confidential. 
If you are not the intended recipient, please: (i) delete the message and all 
copies; (ii) do not disclose, distribute or use the message in any manner; and 
(iii) notify the sender immediately. In addition, please be aware that any 
message addressed to our domain is subject to archiving and review by persons 
other than the intended recipient. Thank you.
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd

RE: Is the Intel X520-SR2 (82599ES) supported by the ixbe driver?

2013-03-15 Thread Dennis Glatting


Sorry for the noise. The problem was old sysctls.


On Fri, 15 Mar 2013, Dennis Glatting wrote:




On Fri, 15 Mar 2013, Teske, Devin wrote:


I suspect you're running out of mbuf clusters.

Try:

echo kern.ipc.nmbclusters=524288  /etc/sysctl.conf
echo kern.ipc.nmbjumbop=524288  /etc/sysctl.conf
reboot


These were my settings:

Keystone sysctl -a kern.ipc.nmbclusters
kern.ipc.nmbclusters: 1048576

Keystone sysctl -a kern.ipc.nmbjumbop
kern.ipc.nmbjumbop: 524288




--
Devin


From: owner-freebsd-questi...@freebsd.org 
[owner-freebsd-questi...@freebsd.org] on behalf of Dennis Glatting 
[d...@pki2.com]

Sent: Friday, March 15, 2013 10:17 AM
To: freebsd-questions@freebsd.org
Subject: Is the Intel X520-SR2 (82599ES) supported by the ixbe driver?

I have a new Intel X520-SR2 that I plopped into my Supermicro H8QGL-6F
with the hope I could connect 10GbE to a Cisco 3560. The links come but
but there is much wierdness. Looking through the driver I see the 82599EB
is supported but no mention of the ES.

Should this work?

I have:

Keystone# uname -a
FreeBSD Keystone 9.1-STABLE FreeBSD 9.1-STABLE #0 r248293: Thu Mar 14
19:31:29 PDT 2013 root@Keystone:/usr/obj/disk-3/src/sys/SECRACK  amd64


Keystone# dmesg | egrep 'ix[01]'
ix0: Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.5.7 -
STABLE/9 port 0x8400-0x841f mem
0xdce8-0xdcef,0xdce7c000-0xdce7 irq 32 at device 0.0 on pci3
ix0: Using MSIX interrupts with 9 vectors
ix0: Ethernet address: 90:e2:ba:2f:5f:9c
ix0: PCI Express Bus: Speed 5.0Gb/s Width x8
ix1: Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.5.7 -
STABLE/9 port 0x8800-0x881f mem
0xdcf8-0xdcff,0xdcf7c000-0xdcf7 irq 33 at device 0.1 on pci3
ix1: Using MSIX interrupts with 9 vectors
ix1: Ethernet address: 90:e2:ba:2f:5f:9d
ix1: PCI Express Bus: Speed 5.0Gb/s Width x8
ix0: link state changed to UP


Keystone# ifconfig ix0
ix0: flags=8843UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST metric 0 mtu 8192

options=407bbRXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO
ether 90:e2:ba:2f:5f:9c
nd6 options=29PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL
media: Ethernet autoselect (10Gbase-SR full-duplex)
status: active


Here's an interesting point. If I set the address for the interface, it is
accepted but an ifconfig of the interface is shown above. Specifically, I
previously executed this command:

Keystone# ifconfig ix0 inet 192.168.3.2/24 mtu 8192 up


Executing that command a second time yields:

Keystone# ifconfig ix0 inet 192.168.3.2/24 mtu 8192 up
ifconfig: ioctl (SIOCAIFADDR): File exists


A truss of that command yields more interesting things, specifically:

kldload(if_ix) ERR#2 'No such file or 
directory'



There is no driver named if_ix. It is also weird that the interface is
named ix0 rather than ixgbe0.


Also, an arp shows:

Keystone# arp -an
? (192.168.17.1) at 2c:21:72:cb:f5:0c on vlan17 expires in 166 seconds
[vlan]
? (192.168.13.33) at 78:e7:d1:ea:7a:4e on vlan13 expires in 760 seconds
[vlan]
? (192.168.13.1) at 2c:21:72:cb:f5:0c on vlan13 expires in 97 seconds
[vlan]
? (192.168.13.3) at 00:21:d8:0b:57:98 on vlan13 expires in 232 seconds
[vlan]
? (192.168.7.6) at dc:7b:94:9a:52:41 on vlan7 expires in 268 seconds
[vlan]
? (192.168.7.4) at e0:2f:6d:30:39:41 on vlan7 expires in 290 seconds
[vlan]
? (192.168.7.3) at 00:21:d8:0b:57:98 on vlan7 expires in 210 seconds
[vlan]
? (192.168.7.66) at 28:92:4a:2e:e0:a0 on vlan7 expires in 1199 seconds
[vlan]
? (192.168.7.33) at 78:e7:d1:ea:7a:4e on vlan7 expires in 143 seconds
[vlan]
? (192.168.7.65) at 28:92:4a:2e:eb:22 on vlan7 expires in 615 seconds
[vlan]
? (192.168.3.2) at 90:e2:ba:2f:5f:9c on ix0 permanent [ethernet]


So clearly there is a MAC/IP association however I cannot ping the IP:


Keystone# ping 192.168.3.2
PING 192.168.3.2 (192.168.3.2): 56 data bytes
(nothing)


Can someone clue me in?




___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to 
freebsd-questions-unsubscr...@freebsd.org


_
The information contained in this message is proprietary and/or 
confidential. If you are not the intended recipient, please: (i) delete the 
message and all copies; (ii) do not disclose, distribute or use the message 
in any manner; and (iii) notify the sender immediately. In addition, please 
be aware that any message addressed to our domain is subject to archiving 
and review by persons other than the intended recipient. Thank you.

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to 
freebsd-questions-unsubscr...@freebsd.org



___
freebsd-questions@freebsd.org mailing

Kernel decision logic on ICMP redirect

2013-01-11 Thread Dennis Glatting
I have a network:


 NetA - GW1 --- GW2 - NetB
 |- GW3 - NetC   
   HostFoo - |

GW1 is a Cisco router running OSPF.

GW2 is FreeBSD 9.1 running OSPF via Quagga, and is forwarding.

GW3 is FreeBSD 9.1 connected to another network and is forwarding.


GW2 has a static route pointing to NetC.


HostFoo has a default route (only) to GW2 and can ping a host on NetC
because it gets an ICMP redirect from GW2 (FreeBSD) to GW3. However, if
HostFoo pings a a host on NetA it DOES NOT get a ICMP redirect from GW2.

Looking through the kernel code, which is where I need help, it seems
routes learned DYNAMIC, in this case GW2 via OSPF from GW1, are not
routes for which redirects will be generated by GW2. Is that true? 

What is it I need to do to convenience GW2 to generate redirects for
learned routes?


 




___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: FreeBSD Hp Proliant DL580 g7 IBM 3650 installation problem‏

2013-01-10 Thread Dennis Glatting



On Thu, 10 Jan 2013, Emre ?amalan wrote:


Hi,

I have got a big computer which has got at least 4 core Hp Proliant 
DL580 g7 server. And it has got HP p410i smart array RAID card.



I tried to install FreeBSD 8.2, 8.3 9.1 from DVD and bootonly cd but 
after passed menu screen I got an error.





I have many HP machines with 410i controllers but no G7s. I haven't had a 
problem installing FreeBSD on them.





Please show me the way for solution.

I attached last screenshot from HP 580.

And IBM machine give an error and restart again and again.
I attached screenshot too.

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: LSI 2008 drivers

2012-11-19 Thread Dennis Glatting
On Mon, 2012-11-19 at 16:41 -0800, Alltek Supplies Tech Support/Customer
Service wrote:
 Good afternoon,
 
 We're looking to build a ZFS storage device with FreeBSD version 8.3,
 however, the Supermicro based hardware comes with LSI 2008 SAS
 controller card and we were told that LSI / Supermicro doesn't have a
 driver for FreeBSD.  We're just wondering if the LSI 2008 is supported
 under FreeBSD version 8.3?
 

The on-board LSI2008 chips on Supermicro boards work fine with 8.3. That
said, I did update mine with the BIOS+firmware from LSI.






___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


ZFS HBAs with 8 ports?

2012-10-31 Thread Dennis Glatting


I am looking for a fairly dense HBA for a ZFS system. I currently use LSI 
2008 chip sets but the boards (e.g., 9211-8i) are limited to eight disks 
and I have twenty four disks, consuming four of my six MB slots. With two 
other cards, that leaves me no empty slots.


I looked at the 9280-24i4e (I also need an external interface) but it 
appears MegaRAID+LSI-2108 /does not/ support JBOD, but that is also 
unclear. One of a few notes in LSI's configuration guide hints:


  NOTE Integrated MegaRAID displays new drives as Just a Bunch of Disks
  (JBOD). For MegaRAID, unless the inserted drive contains valid DDF
  metadata, new drives display as JBOD. Rebuilds start only on
  Unconfigured Good drives, so you have to change the new drive state from
  JBOD to Unconfigured Good to start a rebuild.

That's far from a decleration of useful JBOD and I've seen the term 
JBOD to mean different things.


Do you know of a fairly dense card known to be useful for ZFS? Can you 
comment on the 9280-24i4e?



___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Problems with the LSI 9211-8i or LSI SAS2008 chips?

2012-10-18 Thread Dennis Glatting
I am working with some folks on this list on a ZFS problem where I am
using LSI 9211-8i boards flashed to IT, which use the LSI SAS2008 chips
(I own about ten of these boards). I have used various versions of BIOS
and firmware from LSI in these boards and presently using LSI's most
recent. The 2008 chips are listed as supported in the driver and I have
also used Supermicro boards with these chips.

mps0: LSI SAS2008 port 0xc000-0xc0ff mem
0xfe93c000-0xfe93,0xfe94-0xfe97 irq 32 at device 0.0 on pci3
mps0: Firmware: 14.00.00.00, Driver: 14.00.00.01-fbsd
mps0: IOCCapabilities:
1285cScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc

In the debugging process the question arose related to chip revisions,
firmware revisions, and folks general opinion about the 9211-8i  /or/
recommendation of something better for a ZFS HBA. We /do not/ know if
the problem experienced is this board/chip/firmware, rather we're simply
asking questions about them.

Opinions? Experiences?








___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Is the Intel 82599ES chipset supported (ixgbe)?

2012-10-18 Thread Dennis Glatting


I'm looking throught he source for the ixgbe drivers and see code 
supporting the 82599EB but nothing for the ES. These chips look nearly the 
same but I'm no expert.


I am looking at a Supermicro 10GbE board (AOC-STGN-i2S) trying to 
determine if it'll work under FreeBSD 9.x. Any clue?


The data sheet is here:

ftp://ftp.supermicro.com/CDR-NIC_1.30_for_Add-on_NIC_Cards/MANUALS/datasheet-AOC-STGN-i2S.pdf


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


ERROR: vxgehal-mgmtaux.c: sou vxge_hal_mrpcim_reg_t has too many members: 1911 1023

2012-10-17 Thread Dennis Glatting
While building a kernel, this error was emitted on several compiles:


clang -O -pipe -DVXGE_HAL_RX_MULTI_POST -DVXGE_HAL_TX_MULTI_POST
-D_KERNEL -DKLD_MODULE -nostdinc   -DHAVE_KERNEL_OPTION_HEADERS
-include /disk-2/obj/disk-1/src/sys/DTRACE/opt_global.h -I. -I@
-I@/contrib/altq -fno-common -g -fno-omit-frame-pointer
-I/disk-2/obj/disk-1/src/sys/DTRACE  -mno-aes -mno-avx -mcmodel=kernel
-mno-red-zone -mno-mmx -mno-sse -msoft-float
-fno-asynchronous-unwind-tables -ffreestanding -fstack-protector
-std=iso9899:1999 -Qunused-arguments -fstack-protector -Wall
-Wredundant-decls -Wnested-externs -Wstrict-prototypes
-Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual  -Wundef
-Wno-pointer-sign -fformat-extensions  -Wmissing-include-dirs
-fdiagnostics-show-option  -Wno-error-tautological-compare
-Wno-error-empty-body  -Wno-error-parentheses-equality
-c /disk-1/src/sys/modules/vxge/../../dev/vxge/vxgehal/vxgehal-mgmtaux.c
ctfconvert -L VERSION -g vxgehal-mgmtaux.o
ERROR: vxgehal-mgmtaux.c: sou vxge_hal_mrpcim_reg_t has too many
members: 1911  1023


mc# uname -a
FreeBSD mc 9.1-PRERELEASE FreeBSD 9.1-PRERELEASE #0 r241306M: Sat Oct  6
20:41:22 PDT 2012 root@mc:/usr/obj/disk-1/src/sys/DTRACE  amd64





___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


svn vs csup usage question

2012-10-03 Thread Dennis Glatting
I often modify configuration files in the src and ports tree. Normally
this isn't a problem becuase csup determines which files changed and
pulled fresh copies from the repository.

I doin't see a svn mechansim to do that, for example: 

svn co -verify repo target

It appears the contents of .svn is all that is check on checkout and not
the files themselves.


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: svn vs csup usage question

2012-10-03 Thread Dennis Glatting
On Wed, 2012-10-03 at 14:20 +0200, Trond Endrestøl wrote:
 On Wed, 3 Oct 2012 04:56-0700, Dennis Glatting wrote:
 
  I often modify configuration files in the src and ports tree. Normally
  this isn't a problem becuase csup determines which files changed and
  pulled fresh copies from the repository.
  
  I doin't see a svn mechansim to do that, for example: 
  
  svn co -verify repo target
  
  It appears the contents of .svn is all that is check on checkout and not
  the files themselves.
 
 Do you always checkout a complete source or ports tree?
 

I run this command:

svn co svn://svn.pki2.com/base/stable/9 /disk-2/src

The changes I make are quick hacks, such as changing comilation options
or minor code changes for test. They are (almost) never meant for
permanency. For example, last night I changed the compilation options
for the kernel from -O2 to -O simply to see if that has any impact on
the kernel/ZFS problems I am having. I suspect not, but it is worth a
try. I now want that file restored to its origional state. 


 Maybe svn update --accept X, for some useful value of X is what you 
 want?
 
 According to PDF manual for svn 1.7, page 251, physical PDF page 272, 
 X can be one of:
 
 postpone (p)
 Take no resolution action at all and instead allow the conflicts to be 
 recorded for future resolution.
 
 edit (e)
 Open each conflicted file in a text editor for manual resolution of 
 line-based conflicts.
 
 launch (l)
 Launch an interactive merge conflict resolution tool for each 
 conflicted file.
 
 base
 Choose the file that was the (unmodified) BASE revision before you 
 tried to integrate changes from the server into your working
 copy.
 
 working
 Assuming that you've manually handled the conflict resolution, choose 
 the version of the file as it currently stands in your
 working copy.
 
 mine-full (mf)
 Resolve conflicted files by preserving all local modifications and 
 discarding all changes fetched from the server during the operation
 which caused the conflict.
 
 theirs-full (tf)
 Resolve conflicted files by discarding all local modifications and 
 integrating all changes fetched from the server during the operation
 which caused the conflict.
 
 mine-conflict (mc)
 Resolve conflicted files by preferring local modifications over the 
 changes fetched from the server in conflicting regions of
 each file's content.
 
 theirs-conflict (tc)
 Resolve conflicted files by preferring the changes fetched from the 
 server over local modifications in conflicting regions of
 each file's content.
 
 -- 
 +---++
 | Vennlig hilsen,   | Best regards,  |
 | Trond Endrestøl,  | Trond Endrestøl,   |
 | IT-ansvarlig, | System administrator,  |
 | Fagskolen Innlandet,  | Gjøvik Technical College, Norway,  |
 | tlf. mob.   952 62 567,   | Cellular...: +47 952 62 567,   |
 | sentralbord 61 14 54 00.  | Switchboard: +47 61 14 54 00.  |
 +---++


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


10Gb SFP+ recomendations?

2012-09-26 Thread Dennis Glatting


I'm looking for a reasonable 10Gb SFP+ capable board supported under 
RELENG_9. All I need is one port that will be plugged into a Cisco 
C3KX-NM-10G. It's going into a Supermicro chassis.


Any recomendations?


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Panic 9 .1-PRERELEASE on HP Servers

2012-08-12 Thread Dennis Glatting
I have a number of HP servers and on two of them (so far) I am getting
similar panics on every reboot. I've enclosed a screen shot of one of
the panics. 

A common denominator, so far, is both are compiled using the 4.2+ C
compiler and both are CVSUP mirrors. My other HP machines have not yet
shown the same problem on reboot.


Other data:


Granny# uname -a
FreeBSD Granny 9.1-PRERELEASE FreeBSD 9.1-PRERELEASE #35: Sun Aug 12
13:08:52 MDT 2012 root@Granny:/sys/amd64/compile/PENFORD-amd64
amd64


Granny# tunefs -p /dev/da0p3
tunefs: POSIX.1e ACLs: (-a)disabled
tunefs: NFSv4 ACLs: (-N)   disabled
tunefs: MAC multilabel: (-l)   disabled
tunefs: soft updates: (-n) enabled
tunefs: soft update journaling: (-j)   enabled
tunefs: gjournal: (-J) disabled
tunefs: trim: (-t) disabled
tunefs: maximum blocks per file in a cylinder group: (-e)  4096
tunefs: average file size: (-f)16384
tunefs: average number of files in a directory: (-s)   64
tunefs: minimum percentage of free space: (-m) 8%
tunefs: optimization preference: (-o)  time
tunefs: volume label: (-L) 



___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: Panic 9 .1-PRERELEASE on HP Servers

2012-08-12 Thread Dennis Glatting
Looks like my screen shot was stripped. You can find it here:

http://www.pki2.com/hp.JPG


Also:

Granny cc -v
Using built-in specs.
Target: amd64-undermydesk-freebsd
Configured with: FreeBSD/amd64 system compiler
Thread model: posix
gcc version 4.2.1 20070831 patched [FreeBSD]



On Sun, 2012-08-12 at 13:21 -0700, Dennis Glatting wrote:
 I have a number of HP servers and on two of them (so far) I am getting
 similar panics on every reboot. I've enclosed a screen shot of one of
 the panics. 
 
 A common denominator, so far, is both are compiled using the 4.2+ C
 compiler and both are CVSUP mirrors. My other HP machines have not yet
 shown the same problem on reboot.
 
 
 Other data:
 
 
 Granny# uname -a
 FreeBSD Granny 9.1-PRERELEASE FreeBSD 9.1-PRERELEASE #35: Sun Aug 12
 13:08:52 MDT 2012 root@Granny:/sys/amd64/compile/PENFORD-amd64
 amd64
 
 
 Granny# tunefs -p /dev/da0p3
 tunefs: POSIX.1e ACLs: (-a)disabled
 tunefs: NFSv4 ACLs: (-N)   disabled
 tunefs: MAC multilabel: (-l)   disabled
 tunefs: soft updates: (-n) enabled
 tunefs: soft update journaling: (-j)   enabled
 tunefs: gjournal: (-J) disabled
 tunefs: trim: (-t) disabled
 tunefs: maximum blocks per file in a cylinder group: (-e)  4096
 tunefs: average file size: (-f)16384
 tunefs: average number of files in a directory: (-s)   64
 tunefs: minimum percentage of free space: (-m) 8%
 tunefs: optimization preference: (-o)  time
 tunefs: volume label: (-L) 
 
 
 
 ___
 freebsd...@freebsd.org mailing list
 http://lists.freebsd.org/mailman/listinfo/freebsd-fs
 To unsubscribe, send any mail to freebsd-fs-unsubscr...@freebsd.org


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Panic 9 .1-PRERELEASE on HP Servers

2012-08-12 Thread Dennis Glatting
Looks like my screen shot was stripped. You can find it here:

http://www.pki2.com/hp.JPG


Also:

Granny cc -v
Using built-in specs.
Target: amd64-undermydesk-freebsd
Configured with: FreeBSD/amd64 system compiler
Thread model: posix
gcc version 4.2.1 20070831 patched [FreeBSD]



On Sun, 2012-08-12 at 13:21 -0700, Dennis Glatting wrote:
 I have a number of HP servers and on two of them (so far) I am getting
 similar panics on every reboot. I've enclosed a screen shot of one of
 the panics. 
 
 A common denominator, so far, is both are compiled using the 4.2+ C
 compiler and both are CVSUP mirrors. My other HP machines have not yet
 shown the same problem on reboot.
 
 
 Other data:
 
 
 Granny# uname -a
 FreeBSD Granny 9.1-PRERELEASE FreeBSD 9.1-PRERELEASE #35: Sun Aug 12
 13:08:52 MDT 2012 root@Granny:/sys/amd64/compile/PENFORD-amd64
 amd64
 
 
 Granny# tunefs -p /dev/da0p3
 tunefs: POSIX.1e ACLs: (-a)disabled
 tunefs: NFSv4 ACLs: (-N)   disabled
 tunefs: MAC multilabel: (-l)   disabled
 tunefs: soft updates: (-n) enabled
 tunefs: soft update journaling: (-j)   enabled
 tunefs: gjournal: (-J) disabled
 tunefs: trim: (-t) disabled
 tunefs: maximum blocks per file in a cylinder group: (-e)  4096
 tunefs: average file size: (-f)16384
 tunefs: average number of files in a directory: (-s)   64
 tunefs: minimum percentage of free space: (-m) 8%
 tunefs: optimization preference: (-o)  time
 tunefs: volume label: (-L) 
 
 
 
 ___
 freebsd...@freebsd.org mailing list
 http://lists.freebsd.org/mailman/listinfo/freebsd-fs
 To unsubscribe, send any mail to freebsd-fs-unsubscr...@freebsd.org



___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


AMD Radeon CUDA under FreeBSD?

2012-06-24 Thread Dennis Glatting
I found useful blogs regarding NVIDIA but nothing useful how to get CUDA
installed for the AMD Radeon series chips under FreeBSD, native or
Linux.

Would someone please point me to a clue? Google wasn't helpful.




___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Is ZFS production ready?

2012-06-21 Thread Dennis Glatting
On Thu, 2012-06-21 at 12:03 +0430, Hooman Fazaeli wrote:
 Dear community
 
 In the past, I built a 8TB ZFS log server on freebsd 7.4.
 However, the system  experienced instablility after long up times.
 My main motive to use ZFS was UFS inability to support large
 file systems.
 
 Now, I want to the same thing on 8.3 and wanted to know
 your opinion on ZFS stability. Is there any success story using
 ZFS in 24x7, large volume, heavy duty servers? Is there any
 other option other than ZFS to build larger than 2TB file systems?
 

System 1: 32 cores, Interlagos, 64GB, 18TB RAIDz1
System 2: 64 cores, Interlagos, 128GB, 15TB RAIDz1
System 3: 8 cores, Bulldozer, 16GB, 27TB RAIDz2

Those are the main volumes on those systems. There are smaller ZFS
volumes. I have other systems also ZFS (total of seven systems),
typically with one or more 5-10TB RAIDz1 volumes. All systems RELENG_9.

Stable? Yes. Be sure you have up-to-date FreeBSD kernel and your HBA
firmware is up-to-date. Generally I use LSI 9211 cards.

That said, the weak point is the drives. For example, one system has 6
Hitachi 4TB drives and there are three more in other systems -- 30%
failure rate within one year. I've also had several failures with
Seagate drives across two years. Zero failures with WD drives (12 drives
in one ZFS array, IIRC) however those are slower, cheap drives.

I am also working with compressed volumes because my data is very large
and highly compressable. Compressed volumes, as you would expect, has a
significant kernel performance impact depending on what you are doing.



___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Is ZFS production ready?

2012-06-21 Thread Dennis Glatting
On Thu, 2012-06-21 at 07:55 -0500, wel...@excelsusphoto.com wrote:
 On 21.06.2012 07:39, Dennis Glatting wrote:
 
 
  Stable? Yes. Be sure you have up-to-date FreeBSD kernel and your HBA
  firmware is up-to-date. Generally I use LSI 9211 cards.
 
 
 Does the 9211 support JBOD (complete plain disks, no RAID or single 
 disk RAID mess)?

Typically I simply reburn them with IT firmware however I found under IR
that a disk on an unconfigured port is seen by the kernel and usable but
I haven't looked at any performance impact and I can't say whether
that's a good idea.


-- 
Dennis Glatting d...@pki2.com

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Anyone using freebsd ZFS for large storage servers?

2012-05-31 Thread Dennis Glatting



On Thu, 31 May 2012, Oscar Hodgson wrote:


The subject is pretty much the question.  Perhaps there's a better
place to be asking this question ...

We have (very briefly) discussed the possibility of using FreeBSD
pizza boxes as a storage heads direct attached to external JBOD arrays
with ZFS.  In perusing the list, I haven't stumbled across indications
of people actually doing this.  External JBODs would be running 24 to
48TB each, roughly.  There would be a couple of units.  The pizza
boxes would be used for computational tasks, and nominally would have
8 cores and 96G+ RAM.

Obvious questions are hardware compatibility and stability.  I've set
up small FreeBSD 9 machines with ZFS roots and simple mirrors for
other tasks here, and those have been successful so far.

Observations would be appreciated.




mc:

real memory  = 120259084288 (114688 MB)
FreeBSD/SMP: Multiprocessor System Detected: 64 CPUs
FreeBSD/SMP: 4 package(s) x 16 core(s)

mc  zpool list
NAME SIZE  ALLOC   FREECAP  DEDUP  HEALTH  ALTROOT
disk-1  14.5T  4.95T  9.55T34%  1.00x  ONLINE  -
disk-2   270G   297M   270G 0%  1.00x  ONLINE  -

disk-1, RAIDz1, uses Hitachi 4TB drives.



iirc:

real memory  = 68719476736 (65536 MB)
FreeBSD/SMP: Multiprocessor System Detected: 32 CPUs
FreeBSD/SMP: 2 package(s) x 16 core(s)

iirc zpool list
NAME SIZE  ALLOC   FREECAP  DEDUP  HEALTH  ALTROOT
disk-1  18.1T  6.70T  11.4T36%  1.00x  ONLINE  -
disk-2  5.44T  3.05G  5.43T 0%  1.00x  ONLINE  -

disk-1, RAIDz1, uses a bunch of 2TB drives


I have another storage server named bd3 that has a RAIDz2 array of 2.5T 
drives (11 of them, IIRC) but it is presently powered down for 
maintenance.



btw:

real memory  = 25769803776 (24576 MB)
FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs
FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 SMT threads

btw zpool list
NAME SIZE  ALLOC   FREECAP  DEDUP  HEALTH  ALTROOT
disk-1  9.06T  97.3G  8.97T 1%  1.00x  ONLINE  -
disk-2  9.06T  5.13T  3.93T56%  1.00x  ONLINE  -

Those are smaller RAIDz1 arrays of 1TB and 2TB drives, IIRC.


I also have three other systems, over clocked to 4GHz with 16GB of RAM and 
presently powered off, each with 3 or 4 2TB disks RAIDz1.



None of these systems have external arrays. The storage systems use common 
technologies, such as NFS, to export their space but their primary mission 
is manipulating (sort-of) big data and crypto attacks, though one is being 
converted to a Hadoop node for experimentation.


I have only had four issues over the past year and a half:

1) It is important to keep your ZFS patches up to date and the firmware in 
you controllers up to date. Failure to do this results in a = :(


2) Under heavy I/O my systems freeze for a few seconds. I haven't looked 
into why but they are completely unresponsive. Note I am also using 
compressed volumes (gzip), which puts a substantual load on the kernel.


3) I have had a number of disk failures -- not too many and not too few. 
These are merely an annoyance with no loss of data.


4) In two systems I use OCZ Revo drives. After several months of operating 
they go Tango Uniform, requiring a system boot where they return from the 
dead. None of my other SSD technologies exhibit the same problem.







___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Anyone using freebsd ZFS for large storage servers?

2012-05-31 Thread Dennis Glatting



On Thu, 31 May 2012, Oscar Hodgson wrote:


That helps.  Thank you.

This is an academic departmental instructional / research environment.
We had a great relationship with Sun, they provided great
opportunities to put Solaris in front of students.  Oracle, not so
much, and the Oracle single-tier support model simply isn't affordable
for this business (there's no ROI at the departmental level g).
Solaris is not a viable option.

FreeBSD looks like the next best available option at the moment,
particularly considering the use of the storage heads as compute
machines.  OpenIndiana shows promise.  Nexenta has a great product,
but the user community expects more flexibility in software options.

Is there anything like a list of supported (known good) SAS HBA's?



Most of my HBAs are LSI controllers flashed T. I'm fond of the 9211.




___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Anyone using freebsd ZFS for large storage servers?

2012-05-31 Thread Dennis Glatting



On Thu, 31 May 2012, Kaya Saman wrote:


On Thu, May 31, 2012 at 5:05 PM, Oscar Hodgson oscar.hodg...@gmail.com wrote:

That helps.  Thank you.

This is an academic departmental instructional / research environment.
 We had a great relationship with Sun, they provided great
opportunities to put Solaris in front of students.  Oracle, not so
much, and the Oracle single-tier support model simply isn't affordable
for this business (there's no ROI at the departmental level g).
Solaris is not a viable option.


We found Oracle to be the cheapest out of all the solutions we looked
at: Netapp, MSI, et el.



FreeBSD looks like the next best available option at the moment,
particularly considering the use of the storage heads as compute
machines.  OpenIndiana shows promise.  Nexenta has a great product,
but the user community expects more flexibility in software options.


FreeBSD is better then Linux in my opinion though lacking some
software and multimedia functionality that Linux has and not for the
Desktop as it's not as bleeding edge as say Fedora 16, however, if
FreeBSD offered Gnome3 and supported my wireless NIC I'd be all over
it like a bad rash :-)



Is there anything like a list of supported (known good) SAS HBA's?


LSI HBA's are really good!

For my DIY solution at home I used a SuperMicro system board with
non-RAID LSI HBA...



Similarly:

mc = Tyan S8812WGM3NR
iirc = Supermicro H8DGi
bd3 = Soon another Supermicro H8DGi

Others are consumer boards from Gigabyte (preferred).

I also have a small collection of Supermicro AOC-USAS2-L8i boards. 
Generally, I have had no trouble but ESXi 5.0 hated them.


For work I looked at two Supermicro 848A chassis with a H8QGL board and 20 
3TB disks for two different projects, but they lie in limbo.




It is a similar solution that we will use for our test NAS at work
though we already have a Dell R700 series server. For this setup
however I will need to use an LSI HBA with both internal and external
Mini-SAS ports.

Instead of Promise we will use NetStor JBOD solutions as they work
with 6Gbps drives and overall give better performance.



Oscar


Regards,


Kaya



On Thu, May 31, 2012 at 11:38 AM, Kaya Saman kayasa...@gmail.com wrote:

If this is any consellation I run a 36TB cluster using a self built
server with a Promise DAS (VessJBOD 1840) using ZFS at home! to
support my OpenSource projects and personal files.

As for OS take your pick: NexentaStor, FreeBSD, Solaris 11


All capable, of course Solaris has latest version of ZFS but still.


At work we're looking into getting a StorEdge appliance wich will
handle up to 140+ TB.


I am also in charge of redesigning one of our virtual SAN's to a
FreeBSD ZFS storage system which will run well how many JBOD's can
you fit on the system?? Probably round ~100TB or so.


Regards,


Kaya


On Thu, May 31, 2012 at 4:32 PM, Oscar Hodgson oscar.hodg...@gmail.com wrote:

The subject is pretty much the question.  Perhaps there's a better
place to be asking this question ...

We have (very briefly) discussed the possibility of using FreeBSD
pizza boxes as a storage heads direct attached to external JBOD arrays
with ZFS.  In perusing the list, I haven't stumbled across indications
of people actually doing this.  External JBODs would be running 24 to
48TB each, roughly.  There would be a couple of units.  The pizza
boxes would be used for computational tasks, and nominally would have
8 cores and 96G+ RAM.

Obvious questions are hardware compatibility and stability.  I've set
up small FreeBSD 9 machines with ZFS roots and simple mirrors for
other tasks here, and those have been successful so far.

Observations would be appreciated.

Oscar.
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org

Re: Anyone using freebsd ZFS for large storage servers?

2012-05-31 Thread Dennis Glatting
On Thu, 2012-05-31 at 19:27 -0400, Daniel Staal wrote:
 --As of May 31, 2012 11:24:41 AM -0700, Dennis Glatting is alleged to have 
 said:
 
  2) Under heavy I/O my systems freeze for a few seconds. I haven't looked
  into why but they are completely unresponsive. Note I am also using
  compressed volumes (gzip), which puts a substantual load on the kernel.
 
 --As for the rest, it is mine.
 
 I'm not using as huge a dataset, but I was seeing this behavior as well 
 when I first set my box up.  What was happening was that ZFS was caching 
 *lots* of writes, and then would dump them all to disk at once, during 
 which time the computer was completely occupied with the disk I/O.
 
 The solution (suggested from http://wiki.freebsd.org/ZFSTuningGuide) for 
 me was:
 vfs.zfs.txg.timeout=5
 

Was already set:

mc# sysctl vfs.zfs.txg.timeout
vfs.zfs.txg.timeout: 5



 in loader.conf.  That only allows it to cache writes for 5 seconds, instead 
 of the default 30.  This appears to be the default in the latest versions 
 of FreeBSD, so if you are running an upgraded 9, ignore me.  ;)  (But check 
 the page linked above: There are other suggestions to try.)
 
 Daniel T. Staal
 
 ---
 This email copyright the author.  Unless otherwise noted, you
 are expressly allowed to retransmit, quote, or otherwise use
 the contents for non-commercial purposes.  This copyright will
 expire 5 years after the author's death, or in 30 years,
 whichever is longer, unless such a period is in excess of
 local copyright law.
 ---


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Cloud software ?

2012-05-25 Thread Dennis Glatting
On Fri, 2012-05-25 at 10:11 +0200, Frank Bonnet wrote:
 Hello
 
 I'm searching for a cloud software :-)
 
 More precisely we would like to offer to our students and professors
 a kind of private cloud to access/manipulate  their personnal data
 from almost anywhere and with almost any devices ...
 ( Personnal PC, Mac, smartphones   and tablets ... etc )
 

There is a couple of cheap ways of doing this. First, download the free
version of VMWare ESXi and partition your hardware. Another is to
install VirtualBox, a Type-2 HyperVisor.

Depending on what you consider a cloud, take a look at Hadoop. Hadoop
isn't partitioning hardware but Hadoop and the applications that run on
top of Hadoop can give you an interesting view of these technologies and
how they can be applied to cloudy data.

As for how to get data into/out-of the cloud, let me know how that
works. :)




___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


clang buildworld broken

2012-03-24 Thread Dennis Glatting
I csup RELENG_9 last night and compiled /usr/src and clang is erroring
out:


clang -Os  -fno-guess-branch-probability  -fomit-frame-pointer
-fno-unit-at-a-time  -mno-align-long-strings  -mrtd  -mregparm=3
-DUSE_XREAD  -DUFS1_AND_UFS2  -DFLAGS=0x80  -DSIOPRT=0x3f8  -DSIOFMT=0x3
-DSIOSPD=9600  -I/disk-1/src/sys/boot/i386/boot2/../../common
-I/disk-1/src/sys/boot/i386/boot2/../btx/lib -I.  -Wall
-Waggregate-return -Wbad-function-cast -Wcast-align
-Wmissing-declarations -Wmissing-prototypes -Wnested-externs
-Wpointer-arith -Wshadow -Wstrict-prototypes -Wwrite-strings  -Winline
--param max-inline-insns-single=100  -mllvm -stack-alignment=8 -mllvm
-inline-threshold=3  -mllvm -enable-load-pre=false -ffreestanding
-mpreferred-stack-boundary=2  -mno-mmx -mno-3dnow -mno-sse -mno-sse2
-mno-sse3 -msoft-float -m32 -march=i386 -std=gnu99 -m32
-c /disk-1/src/sys/boot/i386/boot2/sio.S
clang: warning: the clang compiler does not support
'-fno-unit-at-a-time'
clang: warning: argument unused during compilation:
'-fno-guess-branch-probability'
clang: warning: argument unused during compilation:
'-mno-align-long-strings'
clang: warning: argument unused during compilation: '--param
max-inline-insns-single=100'
clang: warning: argument unused during compilation:
'-mpreferred-stack-boundary=2'
ld -static -N --gc-sections -nostdlib -m elf_i386_fbsd -Ttext 0x2000 -o
boot2.out /disk-2/obj/disk-1/src/sys/boot/i386/boot2/../btx/lib/crt0.o
boot2.o sio.o
btxld -v -E 0x2000 -f bin
-b /disk-2/obj/disk-1/src/sys/boot/i386/boot2/../btx/btx/btx -l
boot2.ldr  -o boot2.ld -P 1 boot2.bin
kernel: ver=1.02 size=690 load=9000 entry=9010 map=16M pgctl=1:1
client: fmt=bin size=158d text=0 data=0 bss=0 entry=0
output: fmt=bin size=1e1d text=200 data=1c1d org=0 entry=0
-29 bytes available
*** Error code 1

Stop in /disk-1/src/sys/boot/i386/boot2.
*** Error code 1

Stop in /disk-1/src/sys/boot/i386.
*** Error code 1

Stop in /disk-1/src/sys/boot.
*** Error code 1

Stop in /disk-1/src/sys.
*** Error code 1

Stop in /disk-1/src.
*** Error code 1

Stop in /disk-1/src.
*** Error code 1

Stop in /disk-1/src.
mc#





System:

mc# uname -a
FreeBSD mc 9.0-STABLE FreeBSD 9.0-STABLE #1: Thu Mar 15 23:58:47 PDT
2012 root@mc:/sys/amd64/compile/SMUNI  amd64



Compile options (from the wiki):

.if !defined(CC) || ${CC} == cc
CC=clang
.endif
.if !defined(CXX) || ${CXX} == c++
CXX=clang++
.endif
.if !defined(CPP) || ${CPP} == cpp
CPP=clang-cpp
.endif
NO_WERROR=
WERROR=



dmesg:

mc# cat /var/run/dmesg.boot
Copyright (c) 1992-2012 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights
reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 9.0-STABLE #1: Thu Mar 15 23:58:47 PDT 2012
root@mc:/sys/amd64/compile/SMUNI amd64
CPU: AMD Opteron(TM) Processor 6274  (2200.07-MHz
K8-class CPU)
  Origin = AuthenticAMD  Id = 0x600f12  Family = 15  Model = 1
Stepping = 2

Features=0x178bfbffFPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT

Features2=0x1e98220bSSE3,PCLMULQDQ,MON,SSSE3,CX16,SSE4.1,SSE4.2,POPCNT,AESNI,XSAVE,OSXSAVE,AVX
  AMD Features=0x2e500800SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM
  AMD
Features2=0x1c9bfffLAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,XOP,SKINIT,WDT,LWP,FMA4,NodeId,Topology,b23,b24
  TSC: P-state invariant, performance statistics
real memory  = 103079215104 (98304 MB)
avail memory = 99390640128 (94786 MB)
Event timer LAPIC quality 400
ACPI APIC Table: 120911 APIC1027
FreeBSD/SMP: Multiprocessor System Detected: 64 CPUs
FreeBSD/SMP: 4 package(s) x 16 core(s)
 cpu0 (BSP): APIC ID: 32
 cpu1 (AP): APIC ID: 33
 cpu2 (AP): APIC ID: 34
 cpu3 (AP): APIC ID: 35
 cpu4 (AP): APIC ID: 36
 cpu5 (AP): APIC ID: 37
 cpu6 (AP): APIC ID: 38
 cpu7 (AP): APIC ID: 39
 cpu8 (AP): APIC ID: 40
 cpu9 (AP): APIC ID: 41
 cpu10 (AP): APIC ID: 42
 cpu11 (AP): APIC ID: 43
 cpu12 (AP): APIC ID: 44
 cpu13 (AP): APIC ID: 45
 cpu14 (AP): APIC ID: 46
 cpu15 (AP): APIC ID: 47
 cpu16 (AP): APIC ID: 64
 cpu17 (AP): APIC ID: 65
 cpu18 (AP): APIC ID: 66
 cpu19 (AP): APIC ID: 67
 cpu20 (AP): APIC ID: 68
 cpu21 (AP): APIC ID: 69
 cpu22 (AP): APIC ID: 70
 cpu23 (AP): APIC ID: 71
 cpu24 (AP): APIC ID: 72
 cpu25 (AP): APIC ID: 73
 cpu26 (AP): APIC ID: 74
 cpu27 (AP): APIC ID: 75
 cpu28 (AP): APIC ID: 76
 cpu29 (AP): APIC ID: 77
 cpu30 (AP): APIC ID: 78
 cpu31 (AP): APIC ID: 79
 cpu32 (AP): APIC ID: 96
 cpu33 (AP): APIC ID: 97
 cpu34 (AP): APIC ID: 98
 cpu35 (AP): APIC ID: 99
 cpu36 (AP): APIC ID: 100
 cpu37 (AP): APIC ID: 101
 cpu38 (AP): APIC ID: 102
 cpu39 (AP): APIC ID: 103
 cpu40 (AP): APIC ID: 104
 cpu41 (AP): APIC ID: 105
 cpu42 (AP): APIC ID: 106
 cpu43 (AP): APIC ID: 107
 cpu44 (AP): APIC ID: 108
 cpu45 (AP): APIC ID: 109
 cpu46 (AP): APIC ID: 110
 cpu47 (AP): APIC ID: 111
 cpu48 (AP): APIC ID: 128
 cpu49 (AP): APIC ID: 129
 cpu50 (AP): APIC ID: 130
 cpu51 (AP): APIC 

Can clang compile RELENG_9?

2012-02-11 Thread Dennis Glatting
I get errors when trying to compile RELENG_9 with clang. Is clag suppose
to work when it comes to compiling the OS or am I missing something: 



clang -O2 -pipe  -DUSE_GZIP=1
-I/usr/src/usr.sbin/sysinstall/../../gnu/lib/libodialog -I. -std=gnu99
-fstack-protector -Wsystem-headers -Werror -Wall -Wno-format-y2k
-Wno-uninitialized -Wno-pointer-sign -Wno-tautological-compare
-Wno-unused-value -Wno-parentheses-equality -Wno-unused-function
-Wno-conversion -Wno-switch-enum -Wno-empty-body
-c /usr/src/usr.sbin/sysinstall/dispatch.c
/usr/src/usr.sbin/sysinstall/dispatch.c:594:17: error: format string is
not a
  string literal (potentially insecure) [-Werror,-Wformat-security]
msgConfirm(err);
   ^~~
1 error generated.
*** Error code 1


When compiling the kernel:

clang -c -O2 -pipe -fno-strict-aliasing  -std=c99  -Wall
-Wredundant-decls -Wnested-externs -Wstrict-prototypes
-Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual  -Wundef
-Wno-pointer-sign -fformat-extensions  -Wmissing-include-dirs
-fdiagnostics-show-option  -Wno-error-tautological-compare
-Wno-error-empty-body  -Wno-error-parentheses-equality -nostdinc  -I.
-I../../.. -I../../../contrib/altq -D_KERNEL
-DHAVE_KERNEL_OPTION_HEADERS -include opt_global.h
-fno-omit-frame-pointer -mno-aes -mno-avx -mcmodel=kernel -mno-red-zone
-mno-mmx -msoft-float  -fno-asynchronous-unwind-tables -ffreestanding
-fstack-protector -Werror  ../../../dev/an/if_an.c
../../../dev/an/if_an.c:799:41: error: implicit conversion from
enumeration type
  'enum ieee80211_phytype' to different enumeration type
  'enum ieee80211_phymode' [-Werror,-Wconversion]
mword = ieee80211_rate2media(NULL, r, IEEE80211_T_DS);
  ^~
../../../dev/an/if_an.c:3301:30: error: implicit conversion from
enumeration
  type 'enum ieee80211_phytype' to different enumeration type
  'enum ieee80211_phymode' [-Werror,-Wconversion]
status.an_current_tx_rate, IEEE80211_T_DS);
   ^~
2 errors generated.
*** Error code 1




___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Can clang compile RELENG_9?

2012-02-11 Thread Dennis Glatting

Sorry for the noise. I missed something in the wiki.


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: OpenMP on FreeBSD

2012-02-02 Thread Dennis Glatting



On Thu, 2 Feb 2012, Anton Shterenlikht wrote:


On Wed, Feb 01, 2012 at 04:29:59PM -0800, Dennis Glatting wrote:

On Thu, 2012-02-02 at 00:09 +, Anton Shterenlikht wrote:

I'm new to OpenMP. I wonder
if there are any special considerations
when running OpenMP on FreeBSD?



I run OpenMP. No special consideration. Here's a chunk from my Makefile:

TARG=ecc.enc ecc.dec

$TARG: *.cc *.h Makefile
g++ -Wall -fopenmp -g -O ${INCL} ${LIBS} -o ecc.enc *.cc
g++ -Wall -fopenmp -g -O ${INCL} ${LIBS} -o ecc.dec *.cc



For example, I have this OMP parallelised
fortran program, nested do loops, compiled
with gfortran46. When I run it with 2 threads
on a 2-cpu box, I see in top(1):

  PIDUID   PRI NICE   SIZERES STATE   C   TIMECPU COMMAND
63995   1001890 57048K 34272K CPU11   1:06 55.08% dummy.sx{dummy.sx}
63995   1001870 57048K 34272K RUN 1   1:02 52.39% dummy.sx{dummy.sx}
   11  0   155 ki31 0K32K RUN 0 376:58 51.46% idle{idle: cpu0}
   11  0   155 ki31 0K32K RUN 1 368:18 45.36% idle{idle: cpu1}

I wonder why, even after a minute of run time,
I still have nearly a whole cpu idle?



What is the program doing? I/O can significantly limit OMP value. Also,
you need to make sure you code your loops properly or else you have a
single-threaded application, without warning.


Here's my parallel bit:

!$OMP PARALLEL DEFAULT(NONE) 
!$OMP   SHARED(AEND,SPACE1,SPACE2,SIZE1,SIZE2,SIZE3) 
!$OMP   PRIVATE(STEP,RANDN,X1,X2,X3)

!$OMP DO SCHEDULE(RUNTIME)

  DO X3 = 1,SIZE3
DO X2 = 1,SIZE2
  DO X1 = 1,SIZE1

IF(SPACE1(X1,X2,X3).EQ.0) THEN
  AEND = .FALSE.! UPDATE AT LEAST ONE CELL
  CALL RANDOM_NUMBER(RANDN) ! 0 = RANDN  1
  STEP = NINT(RANDN*2-1)! STEP = [-1 0 1]
  SPACE2(X1,X2,X3) = SPACE1(X1+STEP(1),X2+STEP(2),X3+STEP(3))
END IF

  END DO
END DO
  END DO

!$OMP END DO
!$OMP END PARALLEL

There's no I/O at all. Not sure what you mean
by proper looping. The threads are definitely
created. I use setenv OMP_NUM_THREADS to set
the number of threads. Then I monitor thread
creation with top -H. The number of threads
shown there matches what I set. So I'm pretty
sure the executable is multi-threaded.



The issue I found in C++ is a barrier had to be defined, which is the 
first tagged bracket in my code snippet. Without that barrier the pragma 
on the for loop was single threaded. Can't say about Fortran, sorry.


I haven't coded Fortran since collage and can't comment on your code.



Perhaps I should explore various SCHEDULE options?



Nope. When it works you will notice. Under FreeBSD I do a top -P in a 
second window. You will see the cores get busy.




By the way, what sort of speed-up do you
see with your loop? And what ratio threads/cores
is optimal for you?



A forty five minute task down to seven minutes on an eight core, AMD 8150 
processor running at 4GHz (slightly over clocked). The effort would take 
less time if I recoded using a custom thread/code solution but I'm talking 
about maybe another minute or two. In the end I felt better was the enemy 
of good.





Many thanks

--
Anton Shterenlikht
Room 2.6, Queen's Building
Mech Eng Dept
Bristol University
University Walk, Bristol BS8 1TR, UK
Tel: +44 (0)117 331 5944
Fax: +44 (0)117 929 4423


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: OpenMP on FreeBSD

2012-02-01 Thread Dennis Glatting
On Thu, 2012-02-02 at 00:09 +, Anton Shterenlikht wrote:
 I'm new to OpenMP. I wonder
 if there are any special considerations
 when running OpenMP on FreeBSD?
 

I run OpenMP. No special consideration. Here's a chunk from my Makefile:

TARG=ecc.enc ecc.dec

$TARG: *.cc *.h Makefile
g++ -Wall -fopenmp -g -O ${INCL} ${LIBS} -o ecc.enc *.cc
g++ -Wall -fopenmp -g -O ${INCL} ${LIBS} -o ecc.dec *.cc


 For example, I have this OMP parallelised
 fortran program, nested do loops, compiled
 with gfortran46. When I run it with 2 threads
 on a 2-cpu box, I see in top(1):
 
   PIDUID   PRI NICE   SIZERES STATE   C   TIMECPU COMMAND
 63995   1001890 57048K 34272K CPU11   1:06 55.08% 
 dummy.sx{dummy.sx}
 63995   1001870 57048K 34272K RUN 1   1:02 52.39% 
 dummy.sx{dummy.sx}
11  0   155 ki31 0K32K RUN 0 376:58 51.46% idle{idle: cpu0}
11  0   155 ki31 0K32K RUN 1 368:18 45.36% idle{idle: cpu1}
 
 I wonder why, even after a minute of run time,
 I still have nearly a whole cpu idle?
 

What is the program doing? I/O can significantly limit OMP value. Also,
you need to make sure you code your loops properly or else you have a
single-threaded application, without warning.


 As a result the run time with 2 threads
 is nearly identical to run time with 1 thread. 
 
 It's likely that I'm not using OMP correctly,
 but I wanted to check if there are any
 special FreeBSD related issues to bear
 in mind when coding with OMP.
 

As an example, this is one of my key sections of code in C++. It works.
I can't say for Fortran.


#pragma omp parallel
{

#pragma omp for

  for( size_t i = 0; i  bq.size(); ++i ) {

Block b = bq[ i ];

// Adjust any padding.
//

if( b.size() != b.szSYMS ) {

  eofPad = ( b.szSYMS - b.size());
  for( ssize_t j = b.size(); j  b.szSYMS; ++j )
b.syms()[ j ] = eofPad;

  if( verbose )
fprintf( stderr,
 Padding: read=%ld, pad=%d\n,
 b.size(), eofPad );

  b.size( b.szSYMS );

}

// Encode the buffer.
//

encode_rs_8( b.syms(), b.parity(), 0 );

// Set it to its new size.
//  (the encoder is an outside routine.)
//

b.size( b.szBLOCK );

// Interleave the buffer.
//

add_interleave( b.buf());

  } /* for */
} /* pragma */




 Thanks
 


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Blocking until the network is ready at boot?

2012-01-12 Thread Dennis Glatting
On Thu, 2012-01-12 at 09:57 -0500, kpn...@pobox.com wrote:
 What's the correct way to get the rc.d scripts to block until the
 network interface is _fully_ ready to carry traffic?
 
 The problem I'm having is that the ifconfig of the interface completes
 but the port hasn't reached status: active yet. So the stuff that
 starts next (sendmail, ntpd) can't reach the network. Is there a way
 to get startup to wait until the interface is active?
 

I modify /etc/rc.d/netif and and insert a sleep 15 after the ifconfig
loop. It is an obnoxious problem.
 

 I'm running FreeBSD 8.2/amd64.
 
 bce0: Broadcom NetXtreme II BCM5709 1000Base-T (C0) mem 
 0xd600-0xd7ff irq 36 at device 0.0 on pci1
 miibus0: MII bus on bce0
 brgphy0: BCM5709C 10/100/1000baseTX PHY PHY 1 on miibus0
 brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 
 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-maste
 r, auto, auto-flow
 bce0: Ethernet address: d4:be:d9:ac:a1:e9
 bce0: [ITHREAD]
 



___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


RELENG_9 and mps driver (LSI 9211-8i)

2012-01-07 Thread Dennis Glatting

I have three LSI 9211-8i boards in my system: two flashed to T and one
R. The Ts appear to work fine but the operating system doesn't see the
RAID1 volume on R, but neither did RELENG_8. 

I am writing to ask how well R is supported, if at all. Or, since this
my first case of using R under LSI+FreeBSD, perhaps there is common
mistakes I may be making -- the array is stable.

The boards (mps1 is the board with the RAID1 array):

mps0: LSI SAS2008 port 0xde00-0xdeff mem
0xfd9fc000-0xfd9f,0xfd98-0xfd9b irq 19 at device 0.0 on pci1
mps0: Firmware: 12.00.00.00
mps0: IOCCapabilities:
1285cScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc
mps1: LSI SAS2008 port 0x9e00-0x9eff mem
0xfdefc000-0xfdef,0xfde8-0xfdeb irq 19 at device 0.0 on pci5
mps1: Firmware: 12.00.00.00
mps1: IOCCapabilities:
185cScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,IR
mps2: LSI SAS2008 port 0x8e00-0x8eff mem
0xfdcfc000-0xfdcf,0xfdc8-0xfdcb irq 16 at device 0.0 on pci6
mps2: Firmware: 12.00.00.00
mps2: IOCCapabilities:
1285cScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc



bd3# uname -a
FreeBSD bd3 9.0-STABLE FreeBSD 9.0-STABLE #0: Sat Jan  7 16:09:10 PST
2012 root@bd3:/sys/amd64/compile/BULLDOZER  amd64

(i.e., the OS was csup against RELENG_9 and build today).


Other data:


bd3# dmesg
Copyright (c) 1992-2012 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights
reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 9.0-STABLE #0: Sat Jan  7 16:09:10 PST 2012
root@bd3:/sys/amd64/compile/BULLDOZER amd64
CPU: AMD FX(tm)-8150 Eight-Core Processor(4017.99-MHz
K8-class CPU)
  Origin = AuthenticAMD  Id = 0x600f12  Family = 15  Model = 1
Stepping = 2

Features=0x178bfbffFPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,C
MOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT

Features2=0x1698220bSSE3,PCLMULQDQ,MON,SSSE3,CX16,SSE4.1,SSE4.2,POPCNT,AESNI,
XSAVE,AVX
  AMD Features=0x2e500800SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM
  AMD
Features2=0x1c9bfffLAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,I
BS,XOP,SKINIT,WDT,LWP,FMA4,NodeId,Topology,b23,b24
  TSC: P-state invariant, performance statistics
real memory  = 17179869184 (16384 MB)
avail memory = 16508002304 (15743 MB)
Event timer LAPIC quality 400
ACPI APIC Table: GBTGBTUACPI
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 8 core(s)
cpu0 (BSP): APIC ID:  0
cpu1 (AP): APIC ID:  1
cpu2 (AP): APIC ID:  2
cpu3 (AP): APIC ID:  3
cpu4 (AP): APIC ID:  4
cpu5 (AP): APIC ID:  5
cpu6 (AP): APIC ID:  6
cpu7 (AP): APIC ID:  7
ioapic0: Changing APIC ID to 8
ioapic0 Version 2.1 irqs 0-23 on motherboard
kbd1 at kbdmux0
acpi0: GBT GBTUACPI on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of 0, a (3) failed
acpi0: reservation of 10, cfca (3) failed
Timecounter ACPI-safe frequency 3579545 Hz quality 850
acpi_timer0: 32-bit timer at 3.579545MHz port 0x808-0x80b on acpi0
cpu0: ACPI CPU on acpi0
cpu1: ACPI CPU on acpi0
cpu2: ACPI CPU on acpi0
cpu3: ACPI CPU on acpi0
cpu4: ACPI CPU on acpi0
cpu5: ACPI CPU on acpi0
cpu6: ACPI CPU on acpi0
cpu7: ACPI CPU on acpi0
acpi_button0: Power Button on acpi0
pcib0: ACPI Host-PCI bridge port 0xcf8-0xcff on acpi0
pci0: ACPI PCI bus on pcib0
pci0: base peripheral at device 0.2 (no driver attached)
pcib1: ACPI PCI-PCI bridge irq 19 at device 3.0 on pci0
pci1: ACPI PCI bus on pcib1
mps0: LSI SAS2008 port 0xde00-0xdeff mem
0xfd9fc000-0xfd9f,0xfd98-0xfd
9b irq 19 at device 0.0 on pci1
mps0: Firmware: 12.00.00.00
mps0: IOCCapabilities:
1285cScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,Even
tReplay,HostDisc
pcib2: ACPI PCI-PCI bridge irq 16 at device 4.0 on pci0
pci2: ACPI PCI bus on pcib2
em0: Intel(R) PRO/1000 Network Connection 7.2.3 port 0xcf00-0xcf1f mem
0xfd7c0
000-0xfd7d,0xfd70-0xfd77,0xfd7fc000-0xfd7f irq 16 at
device 0.0
on pci2
em0: Using MSIX interrupts with 3 vectors
em0: Ethernet address: 00:1b:21:c6:d2:a0
pcib3: ACPI PCI-PCI bridge irq 17 at device 9.0 on pci0
pci3: ACPI PCI bus on pcib3
xhci0: XHCI (generic) USB 3.0 controller mem 0xfd5f8000-0xfd5f irq
17 at d
evice 0.0 on pci3
xhci0: 64 byte context size.
usbus0 on xhci0
pcib4: ACPI PCI-PCI bridge irq 18 at device 10.0 on pci0
pci4: ACPI PCI bus on pcib4
ahci0: Marvell 88SE9172 AHCI SATA controller port
0xaf00-0xaf07,0xae00-0xae03,
0xad00-0xad07,0xac00-0xac03,0xab00-0xab0f mem 0xfcbff000-0xfcbff1ff irq
18 at de
vice 0.0 on pci4
ahci0: AHCI v1.00 with 2 6Gbps ports, Port Multiplier supported with FBS
ahcich0: AHCI channel at channel 0 on ahci0
ahcich1: AHCI channel at channel 1 on ahci0
pcib5: ACPI PCI-PCI bridge irq 19 at device 11.0 on pci0
pci5: ACPI PCI bus on pcib5
mps1: LSI SAS2008 port 0x9e00-0x9eff mem
0xfdefc000-0xfdef,0xfde8-0xfd
eb irq 19 at device 0.0 on pci5
mps1: Firmware: 

CPU MHz discrepency

2011-12-31 Thread Dennis Glatting
Curios here. 

My BIOS reports my CPU at 4,023 MHz but when FreeBSD boots it says
3973.35-MHz. How is this determined? Seems like an off-by-one error
somewhere.


MB: ASUS Crosshair V FORMULA, latest BIOS, overclocked.


dmesg output:


Tasha dmesg
Copyright (c) 1992-2011 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights
reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.2-STABLE #7: Fri Dec 30 18:15:12 PST 2011
root@Tasha:/disk-1/src/sys/amd64/compile/TASHA amd64
Timecounter i8254 frequency 1193182 Hz quality 0
CPU: AMD FX(tm)-8150 Eight-Core Processor(3973.35-MHz
K8-class CPU)
  Origin = AuthenticAMD  Id = 0x600f12  Family = 15  Model = 1
Stepping = 2

Features=0x178bfbffFPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT

Features2=0x1698220bSSE3,PCLMULQDQ,MON,SSSE3,CX16,SSE4.1,SSE4.2,POPCNT,AESNI,XSAVE,AVX
  AMD Features=0x2e500800SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM
  AMD
Features2=0x1c9bfffLAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,XOP,SKINIT,WDT,LWP,FMA4,NodeId,Topology,b23,b24
  TSC: P-state invariant
real memory  = 17179869184 (16384 MB)
avail memory = 16470151168 (15707 MB)
ACPI APIC Table: ALASKA A M I
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 8 core(s)
 cpu0 (BSP): APIC ID: 16
 cpu1 (AP): APIC ID: 17
 cpu2 (AP): APIC ID: 18
 cpu3 (AP): APIC ID: 19
 cpu4 (AP): APIC ID: 20
 cpu5 (AP): APIC ID: 21
 cpu6 (AP): APIC ID: 22
 cpu7 (AP): APIC ID: 23
ACPI Warning: Optional field Pm2ControlBlock has zero address or length:
0x/0x1 (20101013/tbfadt-655)
ioapic0 Version 2.1 irqs 0-23 on motherboard
ioapic1 Version 2.1 irqs 24-55 on motherboard
kbd1 at kbdmux0
acpi0: ALASKA A M I on motherboard
acpi0: [ITHREAD]
ACPI Error: [RAMB] Namespace lookup failure, AE_NOT_FOUND
(20101013/psargs-464)
ACPI Exception: AE_NOT_FOUND, Could not execute arguments for [RAMW]
(Region) (20101013/nsinit-452)
acpi0: Power Button (fixed)
Timecounter ACPI-fast frequency 3579545 Hz quality 1000
acpi_timer0: 32-bit timer at 3.579545MHz port 0x808-0x80b on acpi0
cpu0: ACPI CPU on acpi0
cpu1: ACPI CPU on acpi0
cpu2: ACPI CPU on acpi0
cpu3: ACPI CPU on acpi0
cpu4: ACPI CPU on acpi0
cpu5: ACPI CPU on acpi0
cpu6: ACPI CPU on acpi0
cpu7: ACPI CPU on acpi0
acpi_ec0: Embedded Controller: GPE 0xa port 0x62,0x66 on acpi0
acpi_hpet0: High Precision Event Timer iomem 0xfed0-0xfed003ff on
acpi0
Timecounter HPET frequency 14318180 Hz quality 900
pcib0: ACPI Host-PCI bridge port 0xcf8-0xcff on acpi0
pci0: ACPI PCI bus on pcib0
pcib1: ACPI PCI-PCI bridge irq 52 at device 2.0 on pci0
pci1: ACPI PCI bus on pcib1
vgapci0: VGA-compatible display port 0xe000-0xe07f mem
0xfd00-0xfdff,0xc000-0xcfff,0xd000-0xd1ff irq 24
at device 0.0 on pci1
pci1: multimedia, HDA at device 0.1 (no driver attached)
pcib2: ACPI PCI-PCI bridge irq 52 at device 4.0 on pci0
pci2: ACPI PCI bus on pcib2
ahci0: ASMedia ASM1061 AHCI SATA controller port
0xd050-0xd057,0xd040-0xd043,0xd030-0xd037,0xd020-0xd023,0xd000-0xd01f
mem 0xfe30-0xfe3001ff irq 44 at device 0.0 on pci2
ahci0: [ITHREAD]
ahci0: AHCI v1.20 with 2 6Gbps ports, Port Multiplier supported
ahcich0: AHCI channel at channel 0 on ahci0
ahcich0: [ITHREAD]
ahcich1: AHCI channel at channel 1 on ahci0
ahcich1: [ITHREAD]
pcib3: ACPI PCI-PCI bridge irq 52 at device 5.0 on pci0
pci3: ACPI PCI bus on pcib3
em0: Intel(R) PRO/1000 Network Connection 7.2.3 port 0xc000-0xc01f mem
0xfe20-0xfe21,0xfe22-0xfe223fff irq 46 at device 0.0 on pci3
em0: Using an MSI interrupt
em0: [FILTER]
em0: Ethernet address: f4:6d:04:54:f5:52
pcib4: ACPI PCI-PCI bridge irq 54 at device 13.0 on pci0
pci4: ACPI PCI bus on pcib4
em1: Intel(R) PRO/1000 Network Connection 7.2.3 port 0xb000-0xb01f mem
0xfe1c-0xfe1d,0xfe10-0xfe17,0xfe1e-0xfe1e3fff irq 40
at device 0.0 on pci4
em1: Using MSIX interrupts with 3 vectors
em1: [ITHREAD]
em1: [ITHREAD]
em1: [ITHREAD]
em1: Ethernet address: 00:1b:21:c1:b5:39
ahci1: ATI IXP700 AHCI SATA controller port
0xf040-0xf047,0xf030-0xf033,0xf020-0xf027,0xf010-0xf013,0xf000-0xf00f
mem 0xfe407000-0xfe4073ff irq 19 at device 17.0 on pci0
ahci1: [ITHREAD]
ahci1: AHCI v1.20 with 6 6Gbps ports, Port Multiplier supported
ahcich2: AHCI channel at channel 0 on ahci1
ahcich2: [ITHREAD]
ahcich3: AHCI channel at channel 1 on ahci1
ahcich3: [ITHREAD]
ahcich4: AHCI channel at channel 2 on ahci1
ahcich4: [ITHREAD]
ahcich5: AHCI channel at channel 3 on ahci1
ahcich5: [ITHREAD]
ahcich6: AHCI channel at channel 4 on ahci1
ahcich6: [ITHREAD]
ahcich7: AHCI channel at channel 5 on ahci1
ahcich7: [ITHREAD]
ohci0: OHCI (generic) USB controller mem 0xfe406000-0xfe406fff irq 18
at device 18.0 on pci0
ohci0: [ITHREAD]
usbus0: OHCI (generic) USB controller on ohci0
ehci0: EHCI (generic) USB 2.0 controller mem 

Forward error correction routines?

2011-12-13 Thread Dennis Glatting
I am looking for /any/ forward error correction code under FreeBSD,
whether Hamming Codes, Golay Codes, Reed-Solomon, BCH codes, etc. or
convolution encoders/decoders.

All I've found is:

* libfec, which only runs under i386 (I am 64 bit), and
* reed-solomon, which is merely a library and no executables.

Is there any usable utilities? Clue please.






___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


RELENG_8 on AMX FX 8150?

2011-11-09 Thread Dennis Glatting


Does anyone know if this works? I have had one kernel trap and a make 
buildworld fails with this:


cc -O2 -pipe -I. -I/usr/src/lib/libdwarf 
-I/usr/obj/usr/src/tmp/legacy/usr/include -c 
/usr/src/lib/libdwarf/dwarf_errmsg.c

cc: Internal error: Illegal instruction: 4 (program cc1)
Please submit a full bug report.
See URL:http://gcc.gnu.org/bugs.html for instructions.


I also have an error when trying to build gettext-0.18.1.1.tar.gz. It 
could be I have something corrupt, a bad disk, or whatever but it isn't 
obvious and I'm wondering whether anyone is working with that CPU.



bd1# dmesg
Copyright (c) 1992-2011 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.2-STABLE #0: Fri Oct 28 22:47:38 PDT 2011
root@:/usr/src/sys/amd64/compile/WORKHORSE amd64
Timecounter i8254 frequency 1193182 Hz quality 0
CPU: AMD FX(tm)-8150 Eight-Core Processor(3616.17-MHz K8-class 
CPU)
  Origin = AuthenticAMD  Id = 0x600f12  Family = 15  Model = 1  Stepping 
= 2


Features=0x178bfbffFPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT

Features2=0x1698220bSSE3,PCLMULQDQ,MON,SSSE3,CX16,SSE4.1,SSE4.2,POPCNT,AESNI,XSAVE,AVX
  AMD Features=0x2e500800SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM
  AMD 
Features2=0x1c9bfffLAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,XOP,SKINIT,WDT,LWP,FMA4,NodeId,Topology,b23,b24

  TSC: P-state invariant
real memory  = 12884901888 (12288 MB)
avail memory = 12385927168 (11812 MB)
ACPI APIC Table: GBTGBTUACPI
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 8 core(s)
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  2
 cpu3 (AP): APIC ID:  3
 cpu4 (AP): APIC ID:  4
 cpu5 (AP): APIC ID:  5
 cpu6 (AP): APIC ID:  6
 cpu7 (AP): APIC ID:  7
ioapic0: Changing APIC ID to 8
ioapic0 Version 2.1 irqs 0-23 on motherboard
kbd1 at kbdmux0
acpi0: GBT GBTUACPI on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of 0, a (3) failed
acpi0: reservation of 10, cfca (3) failed
Timecounter ACPI-safe frequency 3579545 Hz quality 850
acpi_timer0: 32-bit timer at 3.579545MHz port 0x808-0x80b on acpi0
cpu0: ACPI CPU on acpi0
cpu1: ACPI CPU on acpi0
cpu2: ACPI CPU on acpi0
cpu3: ACPI CPU on acpi0
cpu4: ACPI CPU on acpi0
cpu5: ACPI CPU on acpi0
cpu6: ACPI CPU on acpi0
cpu7: ACPI CPU on acpi0
acpi_button0: Power Button on acpi0
pcib0: ACPI Host-PCI bridge port 0xcf8-0xcff on acpi0
pci0: ACPI PCI bus on pcib0
pcib1: ACPI PCI-PCI bridge irq 19 at device 3.0 on pci0
pci1: ACPI PCI bus on pcib1
mps0: LSI SAS2008 port 0xee00-0xeeff mem 
0xfddfc000-0xfddf,0xfdd8-0xfddb irq 19 at device 0.0 on pci1

mps0: Firmware: 07.00.00.00
mps0: IOCCapabilities: 
185cScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,IR

mps0: [ITHREAD]
pcib2: ACPI PCI-PCI bridge irq 16 at device 4.0 on pci0
pci2: ACPI PCI bus on pcib2
em0: Intel(R) PRO/1000 Network Connection 7.2.3 port 0xdf00-0xdf1f mem 
0xfdbc-0xfdbd,0xfdb0-0xfdb7,0xfdbfc000-0xfdbf irq 16 
at device 0.0 on pci2

em0: Using MSIX interrupts with 3 vectors
em0: [ITHREAD]
em0: [ITHREAD]
em0: [ITHREAD]
em0: Ethernet address: 00:1b:21:c5:f0:6c
pcib3: ACPI PCI-PCI bridge irq 17 at device 9.0 on pci0
pci3: ACPI PCI bus on pcib3
pci3: serial bus, USB at device 0.0 (no driver attached)
pcib4: ACPI PCI-PCI bridge irq 16 at device 12.0 on pci0
pci4: ACPI PCI bus on pcib4
mps1: LSI SAS2008 port 0xbe00-0xbeff mem 
0xfd1fc000-0xfd1f,0xfd18-0xfd1b irq 16 at device 0.0 on pci4

mps1: Firmware: 10.00.02.00
mps1: IOCCapabilities: 
1285cScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc

mps1: [ITHREAD]
pcib5: ACPI PCI-PCI bridge irq 17 at device 13.0 on pci0
pci5: ACPI PCI bus on pcib5
vgapci0: VGA-compatible display port 0xae00-0xaeff mem 
0xd000-0xdfff,0xfdec-0xfded irq 17 at device 0.0 on pci5

pci5: multimedia, HDA at device 0.1 (no driver attached)
atapci0: ATI IXP700/800 SATA300 controller port 
0xff00-0xff07,0xfe00-0xfe03,0xfd00-0xfd07,0xfc00-0xfc03,0xfb00-0xfb0f mem 
0xfdfff000-0xfdfff3ff irq 19 at device 17.0 on pci0

atapci0: [ITHREAD]
atapci0: AHCI v1.20 controller with 6 6Gbps ports, PM supported
ata2: ATA channel 0 on atapci0
ata2: [ITHREAD]
ata3: ATA channel 1 on atapci0
ata3: [ITHREAD]
ata4: ATA channel 2 on atapci0
ata4: [ITHREAD]
ata5: ATA channel 3 on atapci0
ata5: [ITHREAD]
ata6: ATA channel 4 on atapci0
ata6: [ITHREAD]
ata7: ATA channel 5 on atapci0
ata7: [ITHREAD]
ohci0: OHCI (generic) USB controller mem 0xfdffe000-0xfdffefff irq 18 at 
device 18.0 on pci0

ohci0: [ITHREAD]
usbus0: OHCI (generic) USB controller on ohci0
ehci0: EHCI (generic) USB 2.0 controller mem 0xfdffd000-0xfdffd0ff irq 
17 at device 18.2 on pci0

ehci0: [ITHREAD]
usbus1: EHCI version 1.0
usbus1: 

Re: RELENG_8 on AMX FX 8150?

2011-11-09 Thread Dennis Glatting


Never mind, mostly. It is obvious -- duh. Nonetheless, anyone using this 
CPU? I'm curious what you think.


On Thu, 10 Nov 2011, Dennis Glatting wrote:



Does anyone know if this works? I have had one kernel trap and a make 
buildworld fails with this:


cc -O2 -pipe -I. -I/usr/src/lib/libdwarf 
-I/usr/obj/usr/src/tmp/legacy/usr/include -c 
/usr/src/lib/libdwarf/dwarf_errmsg.c

cc: Internal error: Illegal instruction: 4 (program cc1)
Please submit a full bug report.
See URL:http://gcc.gnu.org/bugs.html for instructions.


I also have an error when trying to build gettext-0.18.1.1.tar.gz. It could 
be I have something corrupt, a bad disk, or whatever but it isn't obvious and 
I'm wondering whether anyone is working with that CPU.



bd1# dmesg
Copyright (c) 1992-2011 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
   The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.2-STABLE #0: Fri Oct 28 22:47:38 PDT 2011
   root@:/usr/src/sys/amd64/compile/WORKHORSE amd64
Timecounter i8254 frequency 1193182 Hz quality 0
CPU: AMD FX(tm)-8150 Eight-Core Processor(3616.17-MHz K8-class 
CPU)
 Origin = AuthenticAMD  Id = 0x600f12  Family = 15  Model = 1  Stepping = 
2


Features=0x178bfbffFPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT

Features2=0x1698220bSSE3,PCLMULQDQ,MON,SSSE3,CX16,SSE4.1,SSE4.2,POPCNT,AESNI,XSAVE,AVX
 AMD Features=0x2e500800SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM
 AMD 
Features2=0x1c9bfffLAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,XOP,SKINIT,WDT,LWP,FMA4,NodeId,Topology,b23,b24

 TSC: P-state invariant
real memory  = 12884901888 (12288 MB)
avail memory = 12385927168 (11812 MB)
ACPI APIC Table: GBTGBTUACPI
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 8 core(s)
cpu0 (BSP): APIC ID:  0
cpu1 (AP): APIC ID:  1
cpu2 (AP): APIC ID:  2
cpu3 (AP): APIC ID:  3
cpu4 (AP): APIC ID:  4
cpu5 (AP): APIC ID:  5
cpu6 (AP): APIC ID:  6
cpu7 (AP): APIC ID:  7
ioapic0: Changing APIC ID to 8
ioapic0 Version 2.1 irqs 0-23 on motherboard
kbd1 at kbdmux0
acpi0: GBT GBTUACPI on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of 0, a (3) failed
acpi0: reservation of 10, cfca (3) failed
Timecounter ACPI-safe frequency 3579545 Hz quality 850
acpi_timer0: 32-bit timer at 3.579545MHz port 0x808-0x80b on acpi0
cpu0: ACPI CPU on acpi0
cpu1: ACPI CPU on acpi0
cpu2: ACPI CPU on acpi0
cpu3: ACPI CPU on acpi0
cpu4: ACPI CPU on acpi0
cpu5: ACPI CPU on acpi0
cpu6: ACPI CPU on acpi0
cpu7: ACPI CPU on acpi0
acpi_button0: Power Button on acpi0
pcib0: ACPI Host-PCI bridge port 0xcf8-0xcff on acpi0
pci0: ACPI PCI bus on pcib0
pcib1: ACPI PCI-PCI bridge irq 19 at device 3.0 on pci0
pci1: ACPI PCI bus on pcib1
mps0: LSI SAS2008 port 0xee00-0xeeff mem 
0xfddfc000-0xfddf,0xfdd8-0xfddb irq 19 at device 0.0 on pci1

mps0: Firmware: 07.00.00.00
mps0: IOCCapabilities: 
185cScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,IR

mps0: [ITHREAD]
pcib2: ACPI PCI-PCI bridge irq 16 at device 4.0 on pci0
pci2: ACPI PCI bus on pcib2
em0: Intel(R) PRO/1000 Network Connection 7.2.3 port 0xdf00-0xdf1f mem 
0xfdbc-0xfdbd,0xfdb0-0xfdb7,0xfdbfc000-0xfdbf irq 16 at 
device 0.0 on pci2

em0: Using MSIX interrupts with 3 vectors
em0: [ITHREAD]
em0: [ITHREAD]
em0: [ITHREAD]
em0: Ethernet address: 00:1b:21:c5:f0:6c
pcib3: ACPI PCI-PCI bridge irq 17 at device 9.0 on pci0
pci3: ACPI PCI bus on pcib3
pci3: serial bus, USB at device 0.0 (no driver attached)
pcib4: ACPI PCI-PCI bridge irq 16 at device 12.0 on pci0
pci4: ACPI PCI bus on pcib4
mps1: LSI SAS2008 port 0xbe00-0xbeff mem 
0xfd1fc000-0xfd1f,0xfd18-0xfd1b irq 16 at device 0.0 on pci4

mps1: Firmware: 10.00.02.00
mps1: IOCCapabilities: 
1285cScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc

mps1: [ITHREAD]
pcib5: ACPI PCI-PCI bridge irq 17 at device 13.0 on pci0
pci5: ACPI PCI bus on pcib5
vgapci0: VGA-compatible display port 0xae00-0xaeff mem 
0xd000-0xdfff,0xfdec-0xfded irq 17 at device 0.0 on pci5

pci5: multimedia, HDA at device 0.1 (no driver attached)
atapci0: ATI IXP700/800 SATA300 controller port 
0xff00-0xff07,0xfe00-0xfe03,0xfd00-0xfd07,0xfc00-0xfc03,0xfb00-0xfb0f mem 
0xfdfff000-0xfdfff3ff irq 19 at device 17.0 on pci0

atapci0: [ITHREAD]
atapci0: AHCI v1.20 controller with 6 6Gbps ports, PM supported
ata2: ATA channel 0 on atapci0
ata2: [ITHREAD]
ata3: ATA channel 1 on atapci0
ata3: [ITHREAD]
ata4: ATA channel 2 on atapci0
ata4: [ITHREAD]
ata5: ATA channel 3 on atapci0
ata5: [ITHREAD]
ata6: ATA channel 4 on atapci0
ata6: [ITHREAD]
ata7: ATA channel 5 on atapci0
ata7: [ITHREAD]
ohci0: OHCI (generic) USB controller mem 0xfdffe000-0xfdffefff irq 18 at 
device 18.0 on pci0

ohci0: [ITHREAD]
usbus0: OHCI (generic) USB controller on ohci0
ehci0

Re: Solution for school lab

2011-10-30 Thread Dennis Glatting



On Sun, 30 Oct 2011, Sergio de Almeida Lenzi wrote:


I use a solution that is:
1) a large Freebsd box (phenon X4,8Gb of memory, 1TB disk)
2) OS=Freebsd 8.2 with all gnome2.32 installed
3) Virtualbox 10.x  installed in FreeBSD
4) NT 2003 server with unlimited number of users on rdp (the iso is in
internet or torrent).
5) internet connection
Here this would cost about US$400

Install the system using zfs, insert all users can hold about 1000 users 
Setup FreeBSD to boot diskless (and so will run on all the old machines 
in your place) using either pxe or custom CD.


The users will use Gnome interface, and those who wants windows,
can use via rdesktop, pointing on the NT server on the same machine.

You will need a swith with ONE gigabit port, and the others is
100Mbits...

This setup you have:
about 1200 applictions (from the FreBSDports),
some include:
java, eclipse, python, c, c++, multimedia, web browing, office,
printing, email, chat, calculator, vector drawing, dia (visio),
raster image editor (gimp), monodevelop(.NET devel framework),
sql (postgresql), sql administration (pgadmin3).

Reliable, fast, rock solid, central administration...

It just works



Consider installing VMWare ESXi and instances of whatever operating system 
you like. We have template operating systems we copy to new/replacement 
instances. You can export your disks to the instances but with all things 
you gain some, you loose some.


As someone else mentioned, consider netboot. The booted instance can do 
whatever they want to your hardware but disks are likely to have to be 
re-initialized each time, which is fine if you are using disks for swap 
and other temporary things.


With regard to VirtualBox, someone needs to fix it (probably just update 
the port). The network driver (IIRC) eats memory.





[]

Sergio
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


+ahcich0: Timeout on slot 10 port 0

2011-10-25 Thread Dennis Glatting


Could someone much more knowledgeable please give me a hint as to what 
might I look for and what rs and tfd means. I /think/ I am reading the OS 
is unhappy with the JMB363 chip (see second grep).


TIA


+ahcich0: is  cs 0400 ss  rs 0400 tfd 2451 serr 
 cmd 1000ca17



I have a BluRay drive in here but it is connected to cd0, or:

iirc grep cd0 /var/run/dmesg.boot
cd0 at ahcich0 bus 0 scbus0 target 0 lun 0
cd0: HL-DT-ST BD-RE  BH10LS30 1.00 Removable CD-ROM SCSI-0 device
cd0: Attempt to query device size failed: NOT READY, Medium not present - 
tray closed

cd0 at ahcich0 bus 0 scbus0 target 0 lun 0
cd0: HL-DT-ST BD-RE  BH10LS30 1.00 Removable CD-ROM SCSI-0 device
cd0: 150.000MB/s transfers (SATA 1.x, UDMA6, ATAPI 12bytes, PIO 8192bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present - 
tray closed

cd0 at ahcich0 bus 0 scbus0 target 0 lun 0
cd0: HL-DT-ST BD-RE  BH10LS30 1.00 Removable CD-ROM SCSI-0 device
cd0: 150.000MB/s transfers (SATA 1.x, UDMA6, ATAPI 12bytes, PIO 8192bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present - 
tray closed




iirc grep ahci /var/run/dmesg.boot
ahcich8: [ITHREAD]
ahcich9: AHCI channel at channel 1 on ahci1
ahcich9: [ITHREAD]
ahci2: JMicron JMB363 AHCI SATA controller on atapci2
ahci2: [ITHREAD]
ahci2: AHCI v1.00 with 2 3Gbps ports, Port Multiplier supported
ahcich10: AHCI channel at channel 0 on ahci2
ahcich10: [ITHREAD]
ahcich11: AHCI channel at channel 1 on ahci2
ahcich11: [ITHREAD]
ahci3: Intel ICH10 AHCI SATA controller port 
0xf900-0xf907,0xf800-0xf803,0xf700-0xf707,0xf600-0xf603,0xf500-0xf51f mem 
0xfbffc000-0xfbffc7ff irq 19 at device 31.2 on pci0

ahci3: [ITHREAD]
ahci3: AHCI v1.20 with 6 3Gbps ports, Port Multiplier supported
ahcich12: AHCI channel at channel 0 on ahci3
ahcich12: [ITHREAD]
ahcich13: AHCI channel at channel 1 on ahci3
ahcich13: [ITHREAD]
ahcich14: AHCI channel at channel 2 on ahci3
ahcich14: [ITHREAD]
ahcich15: AHCI channel at channel 3 on ahci3
ahcich15: [ITHREAD]
ahcich16: AHCI channel at channel 4 on ahci3
ahcich16: [ITHREAD]
ahcich17: AHCI channel at channel 5 on ahci3
ahcich17: [ITHREAD]
ahcich7: Poll timeout on slot 0 port 0
ahcich7: is  cs 0001 ss  rs 0001 tfd 50 serr 
 cmd 10004016

ada0 at ahcich9 bus 0 scbus10 target 0 lun 0
ada1 at ahcich12 bus 0 scbus13 target 0 lun 0
ada2 at ahcich13 bus 0 scbus14 target 0 lun 0
ada3 at ahcich14 bus 0 scbus15 target 0 lun 0
ada4 at ahcich15 bus 0 scbus16 target 0 lun 0
ada5 at ahcich16 bus 0 scbus17 target 0 lun 0
ada6 at ahcich17 bus 0 scbus18 target 0 lun 0
cd0 at ahcich0 bus 0 scbus0 target 0 lun 0
ahcich0: Timeout on slot 3 port 0
ahcich0: is  cs 0008 ss  rs 0008 tfd 2451 serr 
 cmd 1000c317

ahcich0: Timeout on slot 3 port 0
ahcich0: is  cs 0008 ss  rs 0008 tfd 2451 serr 
 cmd 1000c317

ahcich0: Timeout on slot 3 port 0
ahcich0: is  cs 0008 ss  rs 0008 tfd 2451 serr 
 cmd 1000c317

ahcich0: Timeout on slot 3 port 0
ahcich0: is  cs 0008 ss  rs 0008 tfd 2451 serr 
 cmd 1000c317
ahci0: Marvell 88SE9128 AHCI SATA controller port 
0xdf00-0xdf07,0xde00-0xde03,0xdd00-0xdd07,0xdc00-0xdc03,0xdb00-0xdb0f mem 
0xfb5ff000-0xfb5ff7ff irq 16 at device 0.0 on pci1

ahci0: [ITHREAD]
ahci0: AHCI v1.20 with 8 6Gbps ports, Port Multiplier not supported
ahcich0: AHCI channel at channel 0 on ahci0
ahcich0: [ITHREAD]
ahcich1: AHCI channel at channel 1 on ahci0
ahcich1: [ITHREAD]
ahcich2: AHCI channel at channel 2 on ahci0
ahcich2: [ITHREAD]
ahcich3: AHCI channel at channel 3 on ahci0
ahcich3: [ITHREAD]
ahcich4: AHCI channel at channel 4 on ahci0
ahcich4: [ITHREAD]
ahcich5: AHCI channel at channel 5 on ahci0
ahcich5: [ITHREAD]
ahcich6: AHCI channel at channel 6 on ahci0
ahcich6: [ITHREAD]
ahcich7: AHCI channel at channel 7 on ahci0
ahcich7: [ITHREAD]
ahci1: JMicron JMB363 AHCI SATA controller mem 0xfbbfe000-0xfbbf irq 
17 at device 0.0 on pci8

ahci1: [ITHREAD]
ahci1: AHCI v1.00 with 2 3Gbps ports, Port Multiplier supported
ahcich8: AHCI channel at channel 0 on ahci1
ahcich8: [ITHREAD]
ahcich9: AHCI channel at channel 1 on ahci1
ahcich9: [ITHREAD]
ahci2: JMicron JMB363 AHCI SATA controller on atapci2
ahci2: [ITHREAD]
ahci2: AHCI v1.00 with 2 3Gbps ports, Port Multiplier supported
ahcich10: AHCI channel at channel 0 on ahci2
ahcich10: [ITHREAD]
ahcich11: AHCI channel at channel 1 on ahci2
ahcich11: [ITHREAD]
ahci3: Intel ICH10 AHCI SATA controller port 
0xf900-0xf907,0xf800-0xf803,0xf700-0xf707,0xf600-0xf603,0xf500-0xf51f mem 
0xfbffc000-0xfbffc7ff irq 19 at device 31.2 on pci0

ahci3: [ITHREAD]
ahci3: AHCI v1.20 with 6 3Gbps ports, Port Multiplier supported
ahcich12: AHCI channel at channel 0 on ahci3
ahcich12: [ITHREAD]
ahcich13: AHCI channel at channel 1 on ahci3
ahcich13: [ITHREAD]
ahcich14: AHCI channel at channel 2 on ahci3
ahcich14: [ITHREAD]
ahcich15: AHCI channel 

Re: Very large swap

2011-10-14 Thread Dennis Glatting



On Fri, 14 Oct 2011, Tim Daneliuk wrote:


On 10/14/2011 11:43 AM, Nikos Vassiliadis wrote:

On 10/14/2011 8:08 AM, Dennis Glatting wrote:


This is kind of stupid question but at a minimum I thought it would be
interesting to know.

What is the limitations in terms of swap devices under RELENG_8 (or 9)?

A single swap dev appears to be limited to 32GB (there are truncation
messages on boot). I am looking at a possible need of 2-20TB (probably
more) with as much main memory that is affordable.


The limit is raised to 256GB in HEAD and RELENG_8
http://svnweb.freebsd.org/base?view=revisionamp;revision=225076


I am working with large data sets and there are various ways of solving
the problem sets but simply letting the processors swap as they work
through a given problem is a possible technique.


I would advise against this technique. Possibly, it's easier to design
your program to user smaller amounts of memory and avoid swapping.

After all, designing your program to use big amounts of swapped out
memory *and* perform in a timely manner, can be very challenging.

Nikos


Well ... I dunno how much large dataset processing you've done, but
it's not that simple.  Ordinarily, with modern machines and
architectures, you're right.  In fact, you NEVER want to swap,
instead, throw memory at the problem.

But when you get into really big datasets, it's a different story.
You probably will not find a mobo with 20TB memory capacity :)
So ... you have to do something with disk.  You generally get
two choices:  Memory mapped files or swap.  It's been some years
since I considered either seriously, but they do have some tradeoffs.
MM files give the programmer very fine grained control of just what
might get pushed out to disk at the cost of user space context
switching.  Swap gets managed by the kernel which is about as
efficient as disk I/O is going to get, but that means what and how
things get moved on- and off disk is invisible to the application.

What a lot of big data shops are moving to is SSD for such operations.
SSD is VERY fast and can be RAIDed to overcome the tendency of at least
the early SSD products' tendency to, um ... blow up.

As always, scale is hard, and giant data problems are Really Hard (tm).
That's why people like IBM, Sun/Oracle, and Teradata make lots of money
building giant iron farms.



This is a proof-of-concept project that is personally educational with a 
substantial amusement factor. I am doing it on the cheap, which means 
commercial products. I'm also doing it at home, which means expenses come 
out of my pocket.


This project is about manipulating and creating large data sets for crypto 
related applications (use your imagination here). The manipulations are 
fairly stupid and generally I am using UNIX utilities because I don't want 
to re-invent existing code (I'm not that bored). I have also written some 
programs but they are no more than a few pages of code. I am also using 
MPI, OpenMP, and pthreads where supported and make sense.


I have committed to the project five machines. Three (the 'attack' 
machines) run over clocked Phenom II x6 processors with 16GB of RAM, 1TB 
disk for the OS, 1TB disk for Junk, and a 3-2TB disk RAIDz array. Two of 
the three MBs (ASUS CROSSHAIR V FORMULA, Gigabyte GA-990FXA-UD7, and 
something I had lying around) are upgradable to 8150s, which I have one on 
order. These machines are liquid cooled because, well, for no reason in 
particular other than I thought it would be fun (defiantly educational). 
Roughly fifty percent of the parts were lying around but more importantly 
my wife and I keep our finances separate. :)


A data manipulation server is running an i7 x4 (not over clocked but turbo 
is enabled) with 24GB of fast RAM. It has 12 2TB disks, 2 1TB disks (OS), 
plus a few SSDs configured across three volumes (OS, Junk, and a work 
volume).


A repository server is an i7 x6 3.3GHz (not over clocked) with 24GB of 
RAM, several volumes, two of which are RAIDz, SSDs, and other junk. I NFS 
the data to the attack servers from this server.


I am using an Intel Gb card, picked because it supports large MTUs.

All are running RELENG_8.

If this project moves beyond proof-of-concept, and therefore not my money, 
we're talking about 100-1,000 TB of data with real servers (SMART, iLO, a 
NMS, etc). I have my doubts this will happen but in the mean time it's 
play day.



___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Very large swap

2011-10-13 Thread Dennis Glatting


This is kind of stupid question but at a minimum I thought it would be 
interesting to know.


What is the limitations in terms of swap devices under RELENG_8 (or 9)?

A single swap dev appears to be limited to 32GB (there are truncation 
messages on boot). I am looking at a possible need of 2-20TB (probably 
more) with as much main memory that is affordable.


I am working with large data sets and there are various ways of solving 
the problem sets but simply letting the processors swap as they work 
through a given problem is a possible technique.


Processors, memory, storage, and other hardware are open issues but for 
the minute I'm doing things on the cheap, which, admittedly, has a certain 
intellectual amusement factor.


TIA

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Support for Bigfoot Killer E2100?

2011-08-25 Thread Dennis Glatting
A number of motherboards (e.g., GigaByte Guerrilla and Sniper) are 
sporting a BIGFOOT Killer E2100 chip, which is also the board's 
Ethernet. Does FreeBSD support this chipset? Anyone tried it?


http://www.bigfootnetworks.com/assets/Company/Media-Center/Datasheets/Final-Killer-E2100-Datasheet.pdf






___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Interrupt storms (an olde but a goode)

2011-08-09 Thread Dennis Glatting


I am having interrupt storms reported on an ASUS RAMPAGE III Extreme MB, 
specifically:


iirc kernel log messages:
+++ /tmp/security.WAPpO605  2011-08-09 03:01:19.0 -0700
+interrupt storm detected on irq16:; throttling interrupt source
+interrupt storm detected on irq16:; throttling interrupt source
+interrupt storm detected on irq16:; throttling interrupt source


I have read other posts and the consensus seems to be: it's your MB. I 
don't understand enough of what this means to make any decision, so I am 
looking for pointers and other input. Is it the MB? If so, what would I 
look for in a replacement.


This system is a ZFS host with 14 (or so) 2TB disks, some SATA SSDs, and a 
Revo SSD, which is kind of nice BTW. The disks are connected by the 
onboard controller and an Aerca board, which seems to work fairly well, 
BTW. Anyway, some data follows.



Some data:

iirc uname -a
FreeBSD iirc 8.2-STABLE FreeBSD 8.2-STABLE #28: Thu Aug  4 15:20:08 PDT 
2011 root@iirc:/usr/src/sys/amd64/compile/IIRC  amd64



iirc vmstat -i
interrupt  total   rate
irq1: atkbd0 155  0
irq16: uhci0++ 377021223920
irq18: ehci0 uhci5  5977  0
irq19: uhci2 uhci4  12850966 31
irq23: uhci3 ehci1 2  0
irq26: arcmsr0 353585806863
cpu0: timer812824701   1984
irq256: ahci0207  0
irq257: em0  1382270  3
irq258: ahci2   64849716158
cpu1: timer812792767   1984
cpu3: timer812792750   1984
cpu2: timer812792693   1984
cpu6: timer812792752   1984
cpu5: timer812792749   1984
cpu7: timer812792779   1984
cpu4: timer812792637   1984
Total 7312070150  17848


iirc grep uhci0 /var/run/dmesg.boot
uhci0: Intel 82801JI (ICH10) USB controller USB-D port 0x9480-0x949f irq 
16 at device 26.0 on pci0

uhci0: [ITHREAD]
uhci0: LegSup = 0x2f00
usbus1: Intel 82801JI (ICH10) USB controller USB-D on uhci0


iirc grep irq /var/run/dmesg.boot |grep 16
uhci0: Intel 82801JI (ICH10) USB controller USB-D port 0x9480-0x949f irq 
16 at device 26.0 on pci0

pcib7: PCI-PCI bridge irq 16 at device 0.0 on pci7
atapci0: SiI 3124 SATA300 controller port 0xec00-0xec0f mem 
0xfbeffc00-0xfbeffc7f,0xfbef-0xfbef7fff irq 16 at device 0.0 on pci8
atapci1: JMicron JMB363 UDMA133 controller port 
0xdc00-0xdc07,0xd880-0xd883,0xd800-0xd807,0xd480-0xd483,0xd400-0xd40f mem 
0xfbdfe000-0xfbdf irq 16 at device 0.0 on pci6



 iirc cat 
/boot/loader.conf.local coretemp_load=YES

vboxdrv_load=YES
atapicam_load=YES
ahci_load=YES
ipmi_load=YES
xhci_load=YES


iirc zpool status
  pool: disk-1
 state: ONLINE
 scan: scrub repaired 0 in 4h19m with 0 errors on Sun Aug  7 07:22:35 2011
config:

NAMESTATE READ WRITE CKSUM
disk-1  ONLINE   0 0 0
  raidz2-0  ONLINE   0 0 0
ada1ONLINE   0 0 0
ada2ONLINE   0 0 0
da1 ONLINE   0 0 0
da2 ONLINE   0 0 0
da3 ONLINE   0 0 0
da4 ONLINE   0 0 0
da5 ONLINE   0 0 0
da6 ONLINE   0 0 0
logs
  ada0  ONLINE   0 0 0
cache
  ad4   ONLINE   0 0 0

errors: No known data errors

  pool: disk-2
 state: ONLINE
 scan: scrub repaired 0 in 0h4m with 0 errors on Sun Aug  7 03:07:13 2011
config:

NAMESTATE READ WRITE CKSUM
disk-2  ONLINE   0 0 0
  mirror-0  ONLINE   0 0 0
ada3ONLINE   0 0 0
ada4ONLINE   0 0 0
cache
  ad6   ONLINE   0 0 0

errors: No known data errors


iirc df -h
Filesystem  SizeUsed   Avail Capacity  Mounted on
/dev/da0s1a 840G 15G757G 2%/
devfs   1.0k1.0k  0B   100%/dev
disk-1  2.3T104G2.2T 4%/disk-1
disk-2  1.8T 21G1.8T 1%/disk-2
disk-1/word.lists10T8.4T2.2T79%/disk-1/word.lists
ln:/ExternalDisk/NFS3.6T1.7G3.6T 0%/NFS


iirc cat /var/run/dmesg.boot
Copyright (c) 1992-2011 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.2-STABLE #28: Thu Aug  4 15:20:08 PDT 2011

zpool remove locks up ZFS under amd64 RELENG_8

2011-07-26 Thread Dennis Glatting


I attached a SSD as a ZIL to a RAIDz pool, which is a fairly useless thing 
to do but I am testing. If I try to remove the SSD ZIL the zpool command 
does not return and in another window a zpool status also doesn't return 
or print anything, typifying a lockup. I also have a SSD attached to the 
pool as a cache.


The pool:

iirc# zpool status disk-1
  pool: disk-1
 state: ONLINE
 scan: scrub repaired 0 in 0h6m with 0 errors on Tue Jul 26 03:07:41 2011
config:

NAMESTATE READ WRITE CKSUM
disk-1  ONLINE   0 0 0
  raidz2-0  ONLINE   0 0 0
ada1ONLINE   0 0 0
ada2ONLINE   0 0 0
da1 ONLINE   0 0 0
da2 ONLINE   0 0 0
da3 ONLINE   0 0 0
da4 ONLINE   0 0 0
da5 ONLINE   0 0 0
da6 ONLINE   0 0 0
logs
  ada0  ONLINE   0 0 0
cache
  ad4   ONLINE   0 0 0

errors: No known data errors


iirc# zpool upgrade
This system is currently running ZFS pool version 28.

All pools are formatted using this version.


iirc# dmesg
Copyright (c) 1992-2011 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.2-STABLE #27: Sat Jul 23 22:55:27 PDT 2011
root@iirc:/usr/src/sys/amd64/compile/IIRC amd64
Timecounter i8254 frequency 1193182 Hz quality 0
CPU: Intel(R) Core(TM) i7 CPU 940  @ 2.93GHz (2960.51-MHz K8-class 
CPU)
  Origin = GenuineIntel  Id = 0x106a4  Family = 6  Model = 1a  Stepping 
= 4


Features=0xbfebfbffFPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE

Features2=0x98e3bdSSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,POPCNT
  AMD Features=0x28100800SYSCALL,NX,RDTSCP,LM
  AMD Features2=0x1LAHF
  TSC: P-state invariant
real memory  = 12884901888 (12288 MB)
avail memory = 12371128320 (11798 MB)
ACPI APIC Table: 051211 APIC1500
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 SMT threads
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  2
 cpu3 (AP): APIC ID:  3
 cpu4 (AP): APIC ID:  4
 cpu5 (AP): APIC ID:  5
 cpu6 (AP): APIC ID:  6
 cpu7 (AP): APIC ID:  7
ioapic0 Version 2.0 irqs 0-23 on motherboard
ioapic1 Version 2.0 irqs 24-47 on motherboard
kbd1 at kbdmux0
acpi0: 051211 XSDT1500 on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of fee0, 1000 (3) failed
acpi0: reservation of 0, a (3) failed
acpi0: reservation of 10, bff0 (3) failed
Timecounter ACPI-fast frequency 3579545 Hz quality 1000
acpi_timer0: 24-bit timer at 3.579545MHz port 0x808-0x80b on acpi0
cpu0: ACPI CPU on acpi0
cpu1: ACPI CPU on acpi0
cpu2: ACPI CPU on acpi0
cpu3: ACPI CPU on acpi0
cpu4: ACPI CPU on acpi0
cpu5: ACPI CPU on acpi0
cpu6: ACPI CPU on acpi0
cpu7: ACPI CPU on acpi0
pcib0: ACPI Host-PCI bridge port 0xcf8-0xcff on acpi0
pci0: ACPI PCI bus on pcib0
pcib1: ACPI PCI-PCI bridge at device 1.0 on pci0
pci1: ACPI PCI bus on pcib1
ahci0: Marvell 88SE912x AHCI SATA controller port 
0xac00-0xac07,0xa880-0xa883,0xa800-0xa807,0xa480-0xa483,0xa400-0xa40f mem 
0xfb9ff800-0xfb9f irq 28 at device 0.0 on pci1

ahci0: [ITHREAD]
ahci0: AHCI v1.20 with 8 6Gbps ports, Port Multiplier not supported
ahcich0: AHCI channel at channel 0 on ahci0
ahcich0: [ITHREAD]
ahcich1: AHCI channel at channel 1 on ahci0
ahcich1: [ITHREAD]
ahcich2: AHCI channel at channel 2 on ahci0
ahcich2: [ITHREAD]
ahcich3: AHCI channel at channel 3 on ahci0
ahcich3: [ITHREAD]
ahcich4: AHCI channel at channel 4 on ahci0
ahcich4: [ITHREAD]
ahcich5: AHCI channel at channel 5 on ahci0
ahcich5: [ITHREAD]
ahcich6: AHCI channel at channel 6 on ahci0
ahcich6: [ITHREAD]
ahcich7: AHCI channel at channel 7 on ahci0
ahcich7: [ITHREAD]
pcib2: ACPI PCI-PCI bridge at device 2.0 on pci0
pci2: ACPI PCI bus on pcib2
xhci0: XHCI (generic) USB 3.0 controller mem 0xfbafe000-0xfbaf irq 
29 at device 0.0 on pci2

xhci0: [ITHREAD]
xhci0: 32 byte context size.
usbus0 on xhci0
pcib3: ACPI PCI-PCI bridge at device 3.0 on pci0
pci3: ACPI PCI bus on pcib3
vgapci0: VGA-compatible display port 0xb000-0xb0ff mem 
0xd000-0xdfff,0xfbbe-0xfbbe irq 24 at device 0.0 on pci3

pci3: multimedia, HDA at device 0.1 (no driver attached)
pcib4: ACPI PCI-PCI bridge at device 5.0 on pci0
pci4: ACPI PCI bus on pcib4
arcmsr0: Areca SAS 6G Host Adapter RAID Controller (RAID6 capable)
port 0xc800-0xc8ff mem 0xfbcf-0xfbcf,0xfbc8-0xfbcb irq 

26 at device 0.0 on pci4
ARECA RAID ADAPTER0: Driver Version 1.20.00.21 2010-03-03
ARECA RAID ADAPTER0: FIRMWARE VERSION V1.49 

Does 8.2 support USB 3.0?

2011-07-18 Thread Dennis Glatting


Sounds like a stupid question to me but I have three motherboards that 
aren't happy with USB 3.0 regardless of settings, including:


* Gigabyte EX58-UD5,
* ASUS Rampage III Extreme, and
* ASUS Crosshair V Formula.

Happy means a variety of things:

 * Sometimes it doesn't like my USB 3.0 sticks,
 * Sometimes it doesn't like my USB 2.0 sticks plugged
   into a 3.0 slot, and
 * Sometimes it does and does not like my mouse or
   keyboard plugged into the port.

On the keyboard front, my Crosshair sees the keyboard before I start kdm4 
but ignores input once started. However, if I hit Ctl-Alt-F1 the usual 
thing happens. It refuses to aknowledge the mouse but I haven't yet tried 
another.


On the Gigabyte and the Crosshair I have ahci loaded, which works BTW. 
However, any problem with the Gigabyte precedes ahci.



___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Lennart Poettering: BSD Isn't Relevant Anymore

2011-07-17 Thread Dennis Glatting



On Sun, 17 Jul 2011, Jerry wrote:


While I usually consider Slashdot nothing more than a bunch of
juveniles ranting against Microsoft; however, I did find this rather
interesting post this morning.

Lennart Poettering: BSD Isn't Relevant Anymore

http://bsd.slashdot.org/story/11/07/16/0020243/Lennart-Poettering-BSD-Isnt-Relevant-Anymore

Interestingly enough, a great deal of it is true. It might be 
interesting to know how others feel about it. Obviously, asking that 
question on this forum is like playing against a stacked deck; however, 
it still might prove interesting.




Yawn. I remember sitting on the can reading BSD mags in the 80s when they 
were saying the same thing regarding OSF. There there were/are other 
Linuxes, BSDs, and Unixes.


I've done a bunch of infrastructure and tasked-support work using Linux 
for the past couple of years. The FreeBSD pieces work better. Does Linux 
have some advantages? Yes. Does FreeBSD have some deficiencies? Yes.


There, I said it. I'm over it now.


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Progress Report: OpenNMS under FreeBSD

2011-07-15 Thread Dennis Glatting


I have OpenNMS-1812 running under FreeBSD 8.2, specifically within a 
VirtualBox instance running FreeBSD 8.2 amd64 itself running under FreeBSD 
8.2 amd64. There were a lot of issues.


By running I mean:

 * A PostgreSQL database is built, running, and initialized,
 * OpenNMS starts and displays its web page, and
 * I can log into that web page with wonderfulness displayed
   on my browser.

PostgreSQL and OpenNMS seem happy. However, I have not yet configured 
OpenNMS to talk to any devices.


Issues included:

 * Sometimes you have to specify JAVA_HOME in the environment
   and other times you MUST NOT.
 * I didn't see any indication of what version of PostgreSQL
   to install so I mistakenly installed 9.1. I later backed
   down to 8.4.
 * OpenNMS requires UTF8 for PostgreSQL but the default
   install does not include it. (BTW, I rebuilt the database
   many times.)
 * I had to suck instrumentationLogReader-1.0-SNAPSHOT.jar out
   of a Linux RPM because the OpenNMS install script could not
   download it from anywhere.
 * I had to set the Java proxies for my site.
 * Many OpenNMS files, such as .xml and .sql files, install
   with the execute bit set. I'm not sure if that is my fault
   or the install process' fault. Nonetheless, it shouldn't
   be that way.
 * Creation and permissions of PostgreSQL entities wasn't
   obvious to me. Where to change the OpenNMS files to
   alter their passwords also wasn't obvious.
 * I did not like the default installation point for the
   PostgreSQL database and moved it to /var/db.
 * I do not like where OpenNMS installs its log files. I prefer
   to create something like /var/log/nms. That said, for now
   I'm not going to touch them and hope they are nicely managed.

Some of these issues stem from the fact that I am not a Java guy, I am not 
a PostgreSQL guy, I preferred my database not to be resident on my NMS, 
my network doesn't NAT for non-interfacing hosts (by design), and 
virtualization, which itself was a non-issue.


BTW, this is one of two sites I plan to deploy OpenNMS under similar 
construct.



___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: OpenNMS under FreeBSD?

2011-07-08 Thread Dennis Glatting



On Wed, 29 Jun 2011, Brandon Gooch wrote:


On Wed, Jun 29, 2011 at 12:03 PM, Dennis Glatting free...@penx.com wrote:

I am looking at OpenNMS under FreeBSD but it isn't in the ports tree
although there are various discussions of OpenNMS under FreeBSD.

Is there a reason why OpenNMS isn't in the ports tree, such as it doesn't
port, no one is willing to step up as a maintainer, or there are licensing
issues?



There is a port here, created by Sevan Janiyan:

http://www.geeklan.co.uk/files/opennms/

I don't know whether or not it's been submitted to ports yet, but I'd
be interested to see if you get it up and running. Report back with
your findings!




Status report. I don't have it working yet but:

1) My NMS requires the use of a proxy to access the web. Configuring
   the proxy is an adventure which I didn't find well documented.

   The key proxy configuration point is in the Java installation but
   it appears not to be the only configuration point. Consequently,
   after humming along downloading and installing Java files the
   process hit another snag.

   I haven't had the chance to chase down which tool and which
   configuration point needs to change. This is a show stopper.

2) OpenNMS requires Postgres. I have a SQL infrastructure and I am
   loath to install yet-another SQL server regardless of its
   wonderfulness, but I have installed it.



___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


make delete-old files always coming back

2011-07-04 Thread Dennis Glatting

Whenever I do an update these files keep getting reinstalled.

Taz# mk delete-old

Removing old files (only deletes safe to delete libs)

remove /usr/include/nfs/krpc.h? y
remove /usr/include/nfs/nfsdiskless.h? y

Old files removed
Removing old directories
Old directories removed

To remove old libraries run 'make delete-old-libs'.

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Trying to understand the mechanics of boot

2011-07-02 Thread Dennis Glatting


I have a system with a large number of disks whose dmesg output is the 
last data component of this message, preceded by my zpool configuration 
which is preceded by my fstab.


I boot off of ad4, which is the MARVELL Raid configured for RAID1 across 
two 1TB disks. The problem I have is if I add more disks to the Areca 
adapter, which is configured JBOD, or the ICH10, which is also configured 
JBOD, the BIOS sees the RAID1 disk, selects it, but when it starts to boot 
the BIOS appears to be the entity that prints the message:


Reboot and Select proper boot device
or insert boot media in selected boot device and press a key

My motherboard is an ASUS RAMPAGE III Extreme but I have tried a different 
MB, in particular a Gigabyte board, with the same result.


I do not see any hint of FreeBSD in the boot process and therefore do not 
know if the BIOS accesses the MBR of my RAID1 array or whetehr the 
problem is the BIOS or FreeBSD boot sequence.


I do understand disk devices will move as one adds or removes disks, 
having had to edit fstab from CD boot many times previously, but I don't 
think that is the problem I am having, not to say it isn't a problem later 
in the boot sequence.


I'm stumped how to go forward with debugging this problem. It appears to 
be some limitation is reached in the BIOSes. I am hopping someone with 
much more detailed knowledge of low level boot/disk sequences can point me 
in a direction.







iirc cat /etc/fstab
# DeviceMountpoint  FStype  Options Dump 
Pass#

/dev/ad4s1b noneswapsw  0   0
/dev/ad4s1a /   ufs rw  1   1
/dev/acd0   /cdrom  cd9660  ro,noauto   0   0


iirc zpool status
  pool: disk-1
 state: ONLINE
 scan: scrub repaired 0 in 1h8m with 0 errors on Sat Jul  2 04:10:41 2011
config:

NAMESTATE READ WRITE CKSUM
disk-1  ONLINE   0 0 0
  raidz1-0  ONLINE   0 0 0
da0 ONLINE   0 0 0
da1 ONLINE   0 0 0
da2 ONLINE   0 0 0
da3 ONLINE   0 0 0

errors: No known data errors

  pool: disk-2
 state: ONLINE
 scan: scrub repaired 0 in 0h3m with 0 errors on Sat Jul  2 03:05:38 2011
config:

NAMESTATE READ WRITE CKSUM
disk-2  ONLINE   0 0 0
  mirror-0  ONLINE   0 0 0
ad34ONLINE   0 0 0
ad36ONLINE   0 0 0
cache
  ad20  ONLINE   0 0 0

errors: No known data errors



iirc dmesg
Copyright (c) 1992-2011 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.2-STABLE #25: Sat Jun 25 17:34:51 PDT 2011
root@iirc:/usr/src/sys/amd64/compile/IIRC amd64
Timecounter i8254 frequency 1193182 Hz quality 0
CPU: Intel(R) Core(TM) i7 CPU 940  @ 2.93GHz (2960.51-MHz K8-class 
CPU)
  Origin = GenuineIntel  Id = 0x106a4  Family = 6  Model = 1a  Stepping 
= 4


Features=0xbfebfbffFPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE

Features2=0x98e3bdSSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,POPCNT
  AMD Features=0x28100800SYSCALL,NX,RDTSCP,LM
  AMD Features2=0x1LAHF
  TSC: P-state invariant
real memory  = 12884901888 (12288 MB)
avail memory = 12371382272 (11798 MB)
ACPI APIC Table: 031711 APIC1638
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 SMT threads
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  2
 cpu3 (AP): APIC ID:  3
 cpu4 (AP): APIC ID:  4
 cpu5 (AP): APIC ID:  5
 cpu6 (AP): APIC ID:  6
 cpu7 (AP): APIC ID:  7
ioapic0 Version 2.0 irqs 0-23 on motherboard
ioapic1 Version 2.0 irqs 24-47 on motherboard
kbd1 at kbdmux0
acpi0: 031711 XSDT1638 on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of fee0, 1000 (3) failed
acpi0: reservation of 0, a (3) failed
acpi0: reservation of 10, bff0 (3) failed
Timecounter ACPI-safe frequency 3579545 Hz quality 850
acpi_timer0: 24-bit timer at 3.579545MHz port 0x808-0x80b on acpi0
cpu0: ACPI CPU on acpi0
cpu1: ACPI CPU on acpi0
cpu2: ACPI CPU on acpi0
cpu3: ACPI CPU on acpi0
cpu4: ACPI CPU on acpi0
cpu5: ACPI CPU on acpi0
cpu6: ACPI CPU on acpi0
cpu7: ACPI CPU on acpi0
pcib0: ACPI Host-PCI bridge port 0xcf8-0xcff on acpi0
pci0: ACPI PCI bus on pcib0
pcib1: ACPI PCI-PCI bridge at device 1.0 on pci0
pci1: ACPI PCI bus on pcib1
atapci0: Marvell AHCI controller port 
0xac00-0xac07,0xa880-0xa883,0xa800-0xa807,0xa480-0xa483,0xa400-0xa40f mem 
0xfb9ff800-0xfb9f irq 28 at device 0.0 

OpenNMS under FreeBSD?

2011-06-29 Thread Dennis Glatting
I am looking at OpenNMS under FreeBSD but it isn't in the ports tree 
although there are various discussions of OpenNMS under FreeBSD.


Is there a reason why OpenNMS isn't in the ports tree, such as it doesn't 
port, no one is willing to step up as a maintainer, or there are licensing 
issues?




___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Using a special proxy for ports

2011-06-27 Thread Dennis Glatting



On Sun, 26 Jun 2011, Dennis Glatting wrote:



I have a requirement where I need to archive ports used across twenty hosts 
for a year or more. I've decided to do this using Squid and to take advantage 
of Squid's cache when updating common ports across those hosts.


(BTW, at another site I used rsync to sync /usr/ports/distfiles across the 
hosts to a local master site then specified _MASTER_SITES_DEFAULT in 
make.conf to a FTP server on the local site. That method works when the port 
is previously cached however if the file isn't in the cache and I 
simultaneously install the port across ten hosts, the port is fetched ten 
times. Sigh.)


I have a Squid proxy installed that isn't meant for every-day/every-user use 
and requires authentication. (Users either go through another Squid proxy or 
direct.) The special Squid proxy works. No surprise there. Authentication 
works. No surprise there.


What I need is a method to embed into make.conf a proxy specification for 
fetch. Setting the environment variable HTTP_PROXY from the login shell /is 
not/ preferred because the account is used by different administrators, I 
don't what the special proxy accidentally polluted with non-port stuff, and 
it would only create confusion.


Setting http_proxy in make.conf does not work. .netrc doesn't appear to be a 
viable method (if it did, I could specify FETCH_ARGS in make.conf).




I forgot to mention that I also thought about redefining SHELL in 
make.conf to a small program that sets HTTP_PROXY in the environment then 
execs the desired target but I felt that approach was fraught with peril.




___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Using a special proxy for ports

2011-06-27 Thread Dennis Glatting



On Mon, 27 Jun 2011, Damien Fleuriot wrote:


On 6/27/11 4:52 AM, Dennis Glatting wrote:


I have a requirement where I need to archive ports used across twenty
hosts for a year or more. I've decided to do this using Squid and to
take advantage of Squid's cache when updating common ports across those
hosts.

(BTW, at another site I used rsync to sync /usr/ports/distfiles across
the hosts to a local master site then specified _MASTER_SITES_DEFAULT in
make.conf to a FTP server on the local site. That method works when the
port is previously cached however if the file isn't in the cache and I
simultaneously install the port across ten hosts, the port is fetched
ten times. Sigh.)

I have a Squid proxy installed that isn't meant for every-day/every-user
use and requires authentication. (Users either go through another Squid
proxy or direct.) The special Squid proxy works. No surprise there.
Authentication works. No surprise there.

What I need is a method to embed into make.conf a proxy specification
for fetch. Setting the environment variable HTTP_PROXY from the login
shell /is not/ preferred because the account is used by different
administrators, I don't what the special proxy accidentally polluted
with non-port stuff, and it would only create confusion.

Setting http_proxy in make.conf does not work. .netrc doesn't appear to
be a viable method (if it did, I could specify FETCH_ARGS in make.conf).



What about using a NFS share for /usr/ports/distfiles ?


Many of these servers provide network/system services across a WAN. If a 
link goes down or is congested, NFS may hang them all. NFS also provides 
certain security challenges.



___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: Using a special proxy for ports

2011-06-27 Thread Dennis Glatting



On Mon, 27 Jun 2011, Damien Fleuriot wrote:




On 6/27/11 4:27 PM, Dennis Glatting wrote:



On Mon, 27 Jun 2011, Damien Fleuriot wrote:


On 6/27/11 4:52 AM, Dennis Glatting wrote:


I have a requirement where I need to archive ports used across twenty
hosts for a year or more. I've decided to do this using Squid and to
take advantage of Squid's cache when updating common ports across those
hosts.

(BTW, at another site I used rsync to sync /usr/ports/distfiles across
the hosts to a local master site then specified _MASTER_SITES_DEFAULT in
make.conf to a FTP server on the local site. That method works when the
port is previously cached however if the file isn't in the cache and I
simultaneously install the port across ten hosts, the port is fetched
ten times. Sigh.)

I have a Squid proxy installed that isn't meant for every-day/every-user
use and requires authentication. (Users either go through another Squid
proxy or direct.) The special Squid proxy works. No surprise there.
Authentication works. No surprise there.

What I need is a method to embed into make.conf a proxy specification
for fetch. Setting the environment variable HTTP_PROXY from the login
shell /is not/ preferred because the account is used by different
administrators, I don't what the special proxy accidentally polluted
with non-port stuff, and it would only create confusion.

Setting http_proxy in make.conf does not work. .netrc doesn't appear to
be a viable method (if it did, I could specify FETCH_ARGS in make.conf).



What about using a NFS share for /usr/ports/distfiles ?


Many of these servers provide network/system services across a WAN. If a
link goes down or is congested, NFS may hang them all. NFS also provides
certain security challenges.




What about using a SSHFS share for /usr/ports/distfiles ?



I don't know much about that file system and will have to look into it. I 
have had problems with FUSE code, as recently as last week (i.e., very 
large files).


How does SSHFS resolve multiple systems simultaneously downloading and 
caching ports? I assume much the same as any file system where there is a 
reasonable risk of content corruption (e.g., one of the downloads abort 
resulting in a partial download or a lack of file locking results in 
multiple processes simultaneously writing to the same file with 
unpredictable content).


Many of my servers provide network/system services over a dodgy ATT MPLS. 
As such, the servers must be as autonomous as possible. In the 
_MASTER_SITES_DEFAULT technique I used at another site, if my site-local 
FTP server is unavailable then fetch does the normal stuff (i.e., it fails 
to the next site in the list). The compromise with a proxy technique is to 
disable the proxy spec if there is a network problem. This works because I 
have three, independent Internet exit points across my WAN linked together 
with local-preferenced BGP.




___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Using a special proxy for ports

2011-06-26 Thread Dennis Glatting


I have a requirement where I need to archive ports used across twenty 
hosts for a year or more. I've decided to do this using Squid and to take 
advantage of Squid's cache when updating common ports across those hosts.


(BTW, at another site I used rsync to sync /usr/ports/distfiles across the 
hosts to a local master site then specified _MASTER_SITES_DEFAULT in 
make.conf to a FTP server on the local site. That method works when the 
port is previously cached however if the file isn't in the cache and I 
simultaneously install the port across ten hosts, the port is fetched ten 
times. Sigh.)


I have a Squid proxy installed that isn't meant for every-day/every-user 
use and requires authentication. (Users either go through another Squid 
proxy or direct.) The special Squid proxy works. No surprise there. 
Authentication works. No surprise there.


What I need is a method to embed into make.conf a proxy specification for 
fetch. Setting the environment variable HTTP_PROXY from the login shell 
/is not/ preferred because the account is used by different 
administrators, I don't what the special proxy accidentally polluted with 
non-port stuff, and it would only create confusion.


Setting http_proxy in make.conf does not work. .netrc doesn't appear to be 
a viable method (if it did, I could specify FETCH_ARGS in make.conf).


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Embedding a RCS token in uname -i

2011-06-21 Thread Dennis Glatting


I have kernel configuration files (e.g., a custom GENERIC) under RCS. For 
example:


==
# $Revision: 1.1$

cpu HAMMER
ident   GENERIC
==

I want to add that 1.1 to the end of GENERIC such that it becomes:

==
# $Revision: 1.1$

cpu HAMMER
ident   GENERIC-1.1
=


Therefore, a uname -i becomes:

btw uname -i
GENERIC-1.1


My goal is to provide a mechanism where I can identify that kernels built 
on a group of machines are running the same kernel built from a 
configuration under RCS.


How can I customized the current config and build mechanisms to accomplish
this? Is there some other way to accomplish this? Is it a dumb idea?


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: FreeBSD Decision

2011-01-14 Thread Dennis Glatting



On Fri, 14 Jan 2011, Alessandro Baggi wrote:

Hi list, I don't want make a flame post but I would ask an objective 
opinion, then not a camp opinion, about using FreeBSD or Debian Linux in 
a production environment for solution as such as cluster of some 
service, proxy, SAN, performance, smp with an high number of cpu, PDC, 
Mail Server (qmail), raid software, security support and hardware 
support. I'm using Slackware Linux but in production environment there 
are problem with packages and distro update and other support. Then for 
you, what is the best for those solutions?




FreeBSD, Debian, and Slowaris are my key components. FreeBSD RELENG_8 
composes most of my WAN services from DNS, SENDMAIL, Cacti, and more. I 
have at least nine servers across the USA. In another life (different job) 
Debian is primary but there are two FreeBSD servers.


I choose FreeBSD because I have source and if necessary recompile the 
whole OS with debug to traipse down a (perceived) bug. The same isn't as 
easy under Debian.


When I (often) come across some behavior I don't understand I almost 
always go to the source. Documentation is almost always less useful when 
it comes to applications. I have also found FreeBSD applications tend to 
be more recent versions or more easily replaced than Debian or CentOS.


I find the FreeBSD handbook useful but when it comes to Debian the 
ErrorNet isn't as... helpful... and often wrong. I spend more time 
tracking things down under Debian than FreeBSD, usually because I go to 
source.


For Wireless there is more functionality under FreeBSD without 
augmentation but for a specific function I had to recompile the source 
with an additional flag. Under Debian I had to replace several modules 
because the drivers did not support AP mode, which included building a 
custom kernel and stripping out conflicting modules -- that was an... 
interesting... exercise.


I prefer the competence of the FreeBSD lists, though I have none myself.


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


X11 Support for Radeon 6850

2010-12-25 Thread Dennis Glatting


I have a Sapphire Toxic Radeon HD 6850 but I cannot find any X11 driver 
that supprts it. The logical choices are radeonhd and ati but neither 
provide joy.


Is there an X11 river for this card?


http://www.newegg.com/Product/Product.aspx?Item=N82E16814102912


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: /usr/include/machine/endian.h:123: syntax error

2010-12-18 Thread Dennis Glatting



On Sat, 18 Dec 2010, Tijl Coosemans wrote:


On Thursday 16 December 2010 07:49:41 Dennis Glatting wrote:


While compiling a port...


btw uname -a
FreeBSD btw 8.2-PRERELEASE FreeBSD 8.2-PRERELEASE #55: Sat Dec 11 22:48:59
PST 2010 r...@btw:/usr/src/sys/amd64/compile/BTW  amd64



btw# portupgrade devel/libgdata

snip

   GISCAN gdata/GData-0.0.gir
/usr/include/machine/endian.h:123: syntax error, unexpected '{' in '
return (__extension__ ({ register __uint64_t __X = (_x); __asm (bswap %0
: +r (__X)); __X; }));' at '{'


I couldn't reproduce this. Do you have any special CFLAGS perhaps?



Not intentionally:

btw# cat /etc/make.conf
USA_RESIDENT=   YES
FORCE_PKG_REGISTER= YES
HAVE_MOTIF= YES
WITHOUT_PERL_MALLOC=YES

WITH_THREADS=   YES
WITHOUT_SAMBA=  YES
WITHOUT_LDAP=   YES
WITHOUT_NLS=YES

OVERRIDE_LINUX_BASE_PORT=f10
OVERRIDE_LINUX_NONBASE_PORTS=f10

WITH_TCL_VER=85

SENDMAIL_CFLAGS=-I/usr/local/include/sasl -DSASL
SENDMAIL_LDFLAGS=-L/usr/local/lib
SENDMAIL_LDADD=-lsasl2


# added by use.perl 2010-12-15 20:47:32
PERL_VERSION=5.12.2

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


/usr/include/machine/endian.h:123: syntax error

2010-12-15 Thread Dennis Glatting


While compiling a port...


btw uname -a
FreeBSD btw 8.2-PRERELEASE FreeBSD 8.2-PRERELEASE #55: Sat Dec 11 22:48:59 
PST 2010 r...@btw:/usr/src/sys/amd64/compile/BTW  amd64




btw# portupgrade devel/libgdata

snip

  GISCAN gdata/GData-0.0.gir
/usr/include/machine/endian.h:123: syntax error, unexpected '{' in ' 
return (__extension__ ({ register __uint64_t __X = (_x); __asm (bswap %0 
: +r (__X)); __X; }));' at '{'


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Any work to update the RealTek Drivers?

2010-12-05 Thread Dennis Glatting
Is there any work going on with the RealTek drivers? The RealTek devices I 
am using support a 9k MTU but the code limits the MTU to the default. Over 
gigabit, a larger MTU is desirable.


Specifically, on one of several machines I am using:

re0: RealTek 8168/8111 B/C/CP/D/DP/E PCIe Gigabit Ethernet port 
0xde00-0xdeff mem 0xfbcff000-0xfbcf,0xfbcf8000-0xfbcfbfff irq 16 at 
device 0.0 on pci7
re1: RealTek 8168/8111 B/C/CP/D/DP/E PCIe Gigabit Ethernet port 
0xce00-0xceff mem 0xfbaff000-0xfbaf,0xfbaf8000-0xfbafbfff irq 17 at 
device 0.0 on pci8



Trying to set the MTU:

btw# ifconfig re1 mtu 4096
ifconfig: ioctl (set mtu): Invalid argument


Looking at the source sys/dev/re/if_re.c

/*-
 * Copyright (c) 1997, 1998-2003
 *  Bill Paul wp...@windriver.com.  All rights reserved.

(snip)

   case RL_HWREV_8168CP:
case RL_HWREV_8168D:
case RL_HWREV_8168DP:
sc-rl_flags |= RL_FLAG_PHYWAKE | RL_FLAG_PAR |
RL_FLAG_DESCV2 | RL_FLAG_MACSTAT | RL_FLAG_CMDSTOP |
RL_FLAG_AUTOPAD;
/*
 * These controllers support jumbo frame but it seems
 * that enabling it requires touching additional magic
 * registers. Depending on MAC revisions some
 * controllers need to disable checksum offload. So
 * disable jumbo frame until I have better idea what
 * it really requires to make it support.
 * RTL8168C/CP : supports up to 6KB jumbo frame.
 * RTL8111C/CP : supports up to 9KB jumbo frame.
 */
sc-rl_flags |= RL_FLAG_NOJUMBO;
break;


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: What's up with cvsup.freebsd.org?

2010-09-03 Thread Dennis Glatting



On Thu, 2 Sep 2010, Greg Larkin wrote:


-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Dennis Glatting wrote:



On Thu, 2 Sep 2010, Lowell Gilbert wrote:


Dennis Glatting free...@penx.com writes:


This has been happening for several days. Is cvsup dead vs SVN? Cvsup
is still listed in the handbook.


cvsup is still fine.  Please (as recommended in the handbook) use a
mirror closer to you.



cvsup1, which has the same IP address as cvsup, /is/ listed as the
server closest to me in the handbook. More specifically:

/usr/local/etc/cvsup/update.sh -L2
CVSup update begins at 2010-09-02 09:46:13
Updating from cvsup1.freebsd.org
Parsing supfile /usr/local/etc/cvsup/supfile
Connecting to cvsup1.freebsd.org
Connected to cvsup1.freebsd.org
Premature EOF from server
CVSup update ends at 2010-09-02 09:46:15

Something has changed in the past several days and I'm now getting
Premature EOF. (I operate a mirror within our enterprise.) If the server
/is fine/, then why have I been getting this message for the past
several days? Nothing has changed on my end.



Hi Dennis,

Instead of relying on a particular cvsup server, how about installing
fastest_cvsup (http://www.freshports.org/sysutils/fastest_cvsup)?

If you run it in your script and pass the resulting hostname to csup,
you'll get the server with the best response at that time.



That was interesting. From one site there isn't a significant difference 
between 1/4/10 -- at least anything worth noteing. From this site, with 
multiple exit points (different vendors) and depending on the BGP bounce 
of the day, I see:



 Speed Daemons:

- 1st: cvsup14.us.freebsd.org   6.22 ms
- 2st: cvsup4.us.freebsd.org30.29 ms
- 3st: cvsup17.us.freebsd.org   44.45 ms


 Speed Daemons:

- 1st: cvsup15.us.freebsd.org   20.96 ms
- 2st: cvsup18.us.freebsd.org   31.66 ms
- 3st: cvsup9.us.freebsd.org31.80 ms

Thanks for the pointer.

BTW, cvsup was 51 ms from the first and 100 ms from the second.




___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


What's up with cvsup.freebsd.org?

2010-09-02 Thread Dennis Glatting


This has been happening for several days. Is cvsup dead vs SVN? Cvsup is 
still listed in the handbook.



CVSup update begins at 2010-09-02 04:40:00
Updating from cvsup.freebsd.org
Connected to cvsup.freebsd.org
Premature EOF from server
CVSup update ends at 2010-09-02 04:40:00


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org


Re: What's up with cvsup.freebsd.org?

2010-09-02 Thread Dennis Glatting



On Thu, 2 Sep 2010, Lowell Gilbert wrote:


Dennis Glatting free...@penx.com writes:


This has been happening for several days. Is cvsup dead vs SVN? Cvsup
is still listed in the handbook.


cvsup is still fine.  Please (as recommended in the handbook) use a 
mirror closer to you.




cvsup1, which has the same IP address as cvsup, /is/ listed as the server 
closest to me in the handbook. More specifically:


/usr/local/etc/cvsup/update.sh -L2
CVSup update begins at 2010-09-02 09:46:13
Updating from cvsup1.freebsd.org
Parsing supfile /usr/local/etc/cvsup/supfile
Connecting to cvsup1.freebsd.org
Connected to cvsup1.freebsd.org
Premature EOF from server
CVSup update ends at 2010-09-02 09:46:15

Something has changed in the past several days and I'm now getting 
Premature EOF. (I operate a mirror within our enterprise.) If the server 
/is fine/, then why have I been getting this message for the past several 
days? Nothing has changed on my end.



___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org