Re: [OmniOS-discuss] areca or lsi

I have used LSI HBAs exclusively. Performance and reliability has been very good. The only problem I have consistently seen is if I hotplug a sas expander with or without disks attached it will crash the system at least half the time. I have simple resolved never doing that hot. I have stuck

[OmniOS-discuss] Heads up: Redhat/CentOS NFSv3 clients file locking failures

A recent change in the NLM for NFSv3 has exposed a problem with the firewall on Redhat/CentOS. Connections back to the client are blocked by the firewall because the connection tracking module is not catching connections as part of the open NFS connections to the server. I have attempted to

Re: [OmniOS-discuss] Overheating faults with ST4000NM0023

You can get the Seagate firmwares from this link: https://apps1.seagate.com/downloads/request.html Seems they don't link to this on their site any more I found it in an old email from their site. -Chip On Tue, Apr 15, 2014 at 5:30 PM, Saso Kiselkov skiselkov...@gmail.comwrote: Hi, I've

Re: [OmniOS-discuss] Overheating faults with ST4000NM0023

multipathing and I'm getting them to flash. -Chip On Thu, Apr 17, 2014 at 12:49 PM, Saso Kiselkov skiselkov...@gmail.comwrote: On 4/17/14, 6:27 PM, Schweiss, Chip wrote: Use the short form of the S/N: Z1Y18H7V Ok, thanks, didn't know there two forms... (FMA only prints one). -- Saso

Re: [OmniOS-discuss] Overheating faults with ST4000NM0023

...@gmail.comwrote: On 4/18/14, 9:23 PM, Schweiss, Chip wrote: I've flashed 0004 to some of my Constellations so far. The drives are now set at a reference temperature of 60C which is much better than 40C. I had to disable mulltipathing to get these disks to flash. I'm not sure

Re: [OmniOS-discuss] Overheating faults with ST4000NM0023

Kiselkov skiselkov...@gmail.comwrote: On 4/18/14, 10:49 PM, Schweiss, Chip wrote: I used Santools, which is a licensed product. From what I understand lsiutil and sg_buffer_write from sg3-utils can do it too. The mode for sg_buffer_write may need to be set to 7 instead of 5 as stated

Re: [OmniOS-discuss] Overheating faults with ST4000NM0023

I suspecting these drives have self-destructed. Can anyone confirm this firmware issue causes the drives to permanently go offline? -Chip On Mon, Apr 21, 2014 at 8:12 AM, Schweiss, Chip c...@innovates.com wrote: I have 20 disks that went offline because they reached 40C before I applied

Re: [OmniOS-discuss] Overheating faults with ST4000NM0023

22, 2014 at 4:36 AM, Saso Kiselkov skiselkov...@gmail.comwrote: On 4/18/14, 10:49 PM, Schweiss, Chip wrote: I used Santools, which is a licensed product. From what I understand lsiutil and sg_buffer_write from sg3-utils can do it too. The mode for sg_buffer_write may need to be set to 7

Re: [OmniOS-discuss] Overheating faults with ST4000NM0023

On Tue, Apr 22, 2014 at 11:15 AM, Richard Elling richard.ell...@richardelling.com wrote: On Apr 21, 2014, at 9:19 AM, Schweiss, Chip c...@innovates.com wrote: I suspecting these drives have self-destructed. Can anyone confirm this firmware issue causes the drives to permanently go offline

Re: [OmniOS-discuss] Overheating faults with ST4000NM0023

mpathadm also panics the kernel on OmniOS if there are any offline disks. Proceed with caution. On Tue, Apr 22, 2014 at 3:08 PM, Richard Elling richard.ell...@richardelling.com wrote: On Apr 22, 2014, at 10:58 AM, Saso Kiselkov skiselkov...@gmail.com wrote: On 4/22/14, 5:03 PM, Schweiss

Re: [OmniOS-discuss] Overheating faults with ST4000NM0023

On Tue, Apr 22, 2014 at 4:02 PM, Saso Kiselkov skiselkov...@gmail.comwrote: # sg_write_buffer -v --in=MegalodonES3-SAS-STD-0004.LOD \ --length=1625600 --mode=5 /dev/rdsk/c9t5000C500578F774Bd0 Write buffer cmd: 3b 05 00 00 00 00 18 ce 00 00 ioctl(USCSICMD) failed with os_err (errno) =

Re: [OmniOS-discuss] Overheating faults with ST4000NM0023

server now sees the disks just fine. There has to be a way to un-retire disks so they can be flashed, but I have not found such a way. -Chip On Tue, Apr 22, 2014 at 11:36 AM, Schweiss, Chip c...@innovates.com wrote: On Tue, Apr 22, 2014 at 11:15 AM, Richard Elling richard.ell

Re: [OmniOS-discuss] ANN: OmniOS r151010 (stable) released

I was looking forward to ZFS bookmarks, but it appears they are not working yet. I upgraded one of my test VMs and tried them: root@ZFSsendTest1:~# zfs snapshot testpool/zfs_send@snap_for_bookmark_test1 root@ZFSsendTest1:~# zfs bookmark testpool/zfs_send@snap_for_bookmark_testbookmark#1 cannot

Re: [OmniOS-discuss] ANN: OmniOS r151010 (stable) released

On Wed, May 7, 2014 at 2:17 PM, Schweiss, Chip c...@innovates.com wrote: I was looking forward to ZFS bookmarks, but it appears they are not working yet. I upgraded one of my test VMs and tried them: root@ZFSsendTest1:~# zfs snapshot testpool/zfs_send@snap_for_bookmark_test1 root

Re: [OmniOS-discuss] ANN: OmniOS r151010 (stable) released

Looks like the documentation needs to a bit clearer on the syntax. This worked: root@ZFSsendTest1:~# zfs bookmark testpool/zfs_send@snap_for_bookmark_test1testpool/zfs_send#bookmark1 On Wed, May 7, 2014 at 2:24 PM, Schweiss, Chip c...@innovates.com wrote: On Wed, May 7, 2014 at 2:17 PM

Re: [OmniOS-discuss] Status of TRIM support?

The 840 Pro doesn't have a super cap, but it does properly honor cache flushes which ZFS will do on a log device. This drastically reduces it's write performance and makes it a poor choice for a log device. Intel has several SATA SSDs with proper super-cap protected caches that make good log

Re: [OmniOS-discuss] Status of TRIM support?

On Wed, May 28, 2014 at 9:46 AM, Doug Hughes d...@will.to wrote: Second this. The DC S3700 are very good. But, I tend to use the Intel 320 which are often available on amazon for just over $1/GB up to 600GB. They don't have as good of specs as the DC3700 (which are newer), but they do have

Re: [OmniOS-discuss] Status of TRIM support?

On Wed, May 28, 2014 at 1:55 PM, Dan Swartzendruber dswa...@druber.comwrote: It looks to me like Sa¨o's design is active/standby failover. Zpool import on the standby should obtain a clean transaction group as long as the originally active system is still not using the pool. The result

Re: [OmniOS-discuss] Win 8.1 NFS client

You may have revealed the cause of a problem I've seen a few times, but have not made the correlation. In my case we have 100+ CentOS NFS clients and a periodic use of 2012R2 server connecting via NFS. I have had a few drop offs of the NFS server with out a single line in the event logs, just

Re: [OmniOS-discuss] Win 8.1 NFS client

The issue I have seen was different. I experienced the same NFSv3 lock manager failures, but with Linux clients. I switched all mounts except VMware to NFSv4 and things became MUCH more stable. I still see periodically the NFS server become unresponsive. The server never crashes or the lock

Re: [OmniOS-discuss] Win 8.1 NFS client

Ctrl-C. The resulting dump file can be examined in wireshark. -Chip THanks! On Mon, Jun 16, 2014 at 10:08 AM, Schweiss, Chip c...@innovates.com wrote: The issue I have seen was different. I experienced the same NFSv3 lock manager failures, but with Linux clients. I switched all mounts

Re: [OmniOS-discuss] NFSv4 client soft lockups

Is you RHEL 6.5 client a virtual machine? If so this message is a red herring to your problem. See the VMware KB article: http://kb.vmware.com/selfservice/microsites/search.do?language=en_UScmd=displayKCexternalId=1009996 I run all NFSv4 from CentOS 6.5 to OmniOS, but do not use kerberos.

Re: [OmniOS-discuss] r151012 nlockmgr fails to start

On Mon, Oct 6, 2014 at 9:59 AM, Dan McDonald dan...@omniti.com wrote: On Oct 6, 2014, at 10:41 AM, Schweiss, Chip c...@innovates.com wrote: Anyone else seeing this in r151012? Any tips on collecting better information on this would be appreciated. I saw this in once in 012

Re: [OmniOS-discuss] r151012 nlockmgr fails to start

mapped to a different location. nlockmgr is becoming a real show stopper. -Chip I've done 3 other upgrades to r151012 and none of them had a problem with nlockmgr... Kevin On 10/06/2014 09:56 AM, Schweiss, Chip wrote: On Mon, Oct 6, 2014 at 9:59 AM, Dan McDonald dan...@omniti.com

Re: [OmniOS-discuss] r151012 nlockmgr fails to start

On Thu, Oct 9, 2014 at 9:54 PM, Dan McDonald dan...@omniti.com wrote: On Oct 9, 2014, at 10:23 PM, Schweiss, Chip c...@innovates.com wrote: Just tried my 2nd system. r151010 nlockmgr starts after clearing maintenance mode. r151012 it will not start at all. nfs/status was enabled

Re: [OmniOS-discuss] Dell R730xd

Recently we had a quote from Dell w/ Nexenta. They specify Intel NICs and LSI HBAs when building with Nexenta. -Chip On Mon, Oct 20, 2014 at 10:58 AM, Marion Hakanson hakan...@ohsu.edu wrote: I don't know if it's true for the R730xd, but Dell will equip your R720xd with an LSI-branded HBA

Re: [OmniOS-discuss] OmniOS bloody now updated.

I went to grab the latest Bloody today, the download links seems to be broken on this page: http://omnios.omniti.com/wiki.php/Installation Is there a better link? -Chip On Tue, Oct 21, 2014 at 12:17 AM, Dan McDonald dan...@omniti.com wrote: Pardon the delay. I was waiting for one of the new

Re: [OmniOS-discuss] OmniOS bloody now updated.

That did it. Thanks! -Chip On Tue, Oct 28, 2014 at 2:24 PM, Dan McDonald dan...@omniti.com wrote: On Oct 28, 2014, at 3:22 PM, Dan McDonald dan...@omniti.com wrote: On Oct 28, 2014, at 3:18 PM, Schweiss, Chip c...@innovates.com wrote: I went to grab the latest Bloody today

[OmniOS-discuss] Installing on VMware Workstation

I've been regularly using OmniOS on ESXi since r151006 without issue. I'm stuck trying to install on VMware Workstation 10 on Windows 7 64bit. At the Welcome to OmniOS screen it dies after pressing F2 and returns to installation menu every time. I've tried telling VMware it's Solaris 11/64,

Re: [OmniOS-discuss] Installing on VMware Workstation

. It should work. Fred 2014-10-28 22:00 GMT+01:00 Schweiss, Chip c...@innovates.com: I've been regularly using OmniOS on ESXi since r151006 without issue. I'm stuck trying to install on VMware Workstation 10 on Windows 7 64bit. At the Welcome to OmniOS screen it dies after pressing F2

[OmniOS-discuss] crash dump speed painfully slow

I had a system crash this morning when I/O on a pool was hung with failmode=panic. That was 7 1/2 hours ago and it's at 64%.I'm going to let it complete so the failure can be analyzed more, but I really need to find a way to significantly speed up the crash dumps. This system has 256GB ram

Re: [OmniOS-discuss] [discuss] crash dump speed painfully slow

On Wed, Nov 5, 2014 at 2:36 PM, Dan McDonald dan...@omniti.com wrote: On Nov 5, 2014, at 3:31 PM, Schweiss, Chip via illumos-discuss disc...@lists.illumos.org wrote: I had a system crash this morning when I/O on a pool was hung with failmode=panic. What version of OmniOS are you

Re: [OmniOS-discuss] Installer dependency on a Floppy

, Nov 25, 2014 at 2:04 PM, Schweiss, Chip c...@innovates.com wrote: Started an installation a new Haswell based Supermicro server. (*X10DRU-i+ * http://www.supermicro.com/products/motherboard/Xeon/C600/X10DRU-i_.cfmmotherboard) The floppy controller is completely gone from these systems

Re: [OmniOS-discuss] Installer dependency on a Floppy

On Tue, Nov 25, 2014 at 3:34 PM, Paul B. Henson hen...@acm.org wrote: On Tue, Nov 25, 2014 at 03:04:35PM -0600, Schweiss, Chip wrote: The floppy controller is completely gone from these systems and causing the installer to panic when loading. Anyone aware of a workaround? Check

Re: [OmniOS-discuss] Installer dependency on a Floppy

X2APCI is the culprit. Needs to be disabled in the BIOs. Worked without the floppy at all. Hopefully this will be useful to someone else. -Chip On Tue, Nov 25, 2014 at 3:49 PM, Schweiss, Chip c...@innovates.com wrote: Beginning to suspect this is something else. OpenIndiana's ISO panics

Re: [OmniOS-discuss] anyone doing DirectPath I/O?

I've been using DirectPath with ESXi 5.0 with an LSI HBA for almost 2 years to an OpenIndiana server. It's been very stable: root@zfs01:~# uptime 21:01pm up 649 days 6:58, 2 users, load average: 0.46, 0.30, 0.25 On Wed, Dec 3, 2014 at 6:10 PM, Joseph Boren jbo...@drakecooper.com wrote:

Re: [OmniOS-discuss] Parity error on path mpt_sas2

I've got some new LSI HBAs I'm trying to downgrade from firmware version 20 to 18. I'm getting errors when trying to downgrade: Attempting to flash firmware to LSI SAS SAS2308_2(D1) : Executing Operation: Flash Firmware Image Firmware Image has a Valid Checksum.

Re: [OmniOS-discuss] Parity error on path mpt_sas2

with sas2flsh -f XX.bin -b mptsas2.rom Filip *From:* OmniOS-discuss [mailto:omnios-discuss-boun...@lists.omniti.com] *On Behalf Of *Schweiss, Chip *Sent:* Monday, December 08, 2014 08:09 AM *To:* Filip Marvan *Cc:* omnios-discuss@lists.omniti.com *Subject:* Re: [OmniOS-discuss] Parity

Re: [OmniOS-discuss] live lsi firmware upgrade P17-P19

On Thu, Dec 11, 2014 at 9:44 AM, Tobias Oetiker t...@oetiker.ch wrote: I am looking at upgrading the firmware of our LSI HBAs to P19 since we suspect that our use of P17 is the cause for disk timeouts we are seeing every few weeks. I am wondering, is it save to flash the HBAs from a running

Re: [OmniOS-discuss] NFSv4 id mapping only working on client but not server?

It seems there a many ways to map ID in NFSv4, is there a way to not map them at all? I'm working to configure an OmniOS NFS server that will serve several domains simultaneously. Each which has their own ID map with many conflicting uid/gid across the domains. All the current file systems

Re: [OmniOS-discuss] Postgres on Stable

I use OpenCSW for Postgres and many other packages on OmniOS. While targeted at Solaris, OpenCSW packages have worked flawlessly for me on OmniOS. http://www.opencsw.org/ -Chip On Mon, Dec 29, 2014 at 12:40 AM, Michael Mounteney gat...@landcroft.co.uk wrote: On Fri, 28 Nov 2014 18:37:09

Re: [OmniOS-discuss] Windows crashes my ZFS box

On Sun, Feb 1, 2015 at 6:21 PM, Rune Tipsmark r...@steait.net wrote: I got some major problems... when using Windows and Fibre Channel I am able to kill my ZFS box totally for at least 15 minutes... it simply drops all connections to all hosts connected via FC. This happens under load, for

Re: [OmniOS-discuss] FINALLY - OmniOS bloody is now updated. (long, please read)

...@omniti.com wrote: On Feb 3, 2015, at 4:07 PM, Schweiss, Chip c...@innovates.com wrote: Good to know. Regardless, I will run bloody until I'm ready to go live on this system. Hopefully I can contribute some valuable information, even if it is in the form of crash dumps. Crash dumps

Re: [OmniOS-discuss] FINALLY - OmniOS bloody is now updated. (long, please read)

On Tue, Feb 3, 2015 at 2:59 PM, Dan McDonald dan...@omniti.com wrote: It has the latest illumos-gate versions of things as of two days ago. Very recently (mid-January) we backported all mpt_sas stuff into 012 and 006. So if you're updated to the latest 012, you won't have much new in

Re: [OmniOS-discuss] Dell vs. Supermicro and any recommendations..

On Wed, Feb 18, 2015 at 7:41 AM, Andy omn...@citrus-it.net wrote: I'd prefer to run Supermicro but might have some problems convincing those with the purse strings. Is anyone running, or can anyone recommend, a Supermicro server roughly equivalent to the Del R730xd, or give me an idea of

Re: [OmniOS-discuss] OmniOS Bloody update for Feb 18

I will second that request as my OmniOS experiments always start as VMware VMs. -Chip On Fri, Feb 20, 2015 at 3:17 AM, Alexander Lesle gro...@tierarzt-mueller.de wrote: Hello Dan McDonald and List, do your remember my feature request? ,-[ ]- | | at Friday, 3. Okt. 2014 17:22 Dan

Re: [OmniOS-discuss] High Availability storage with ZFS

On Tue, Jan 6, 2015 at 5:16 AM, Filip Marvan filip.mar...@aira.cz wrote: Hi as few guys before, I'm thinking again about High Availability storage with ZFS. I know, that there is great commercial RSF-1, but that's quite expensive for my needs. I know, that Sašo did a great job about that

Re: [OmniOS-discuss] About P19

I have P19 on 3 active servers. No issues. I consider it safe. Also interesting, P20 was on them when I first purchased them. It was nearly a month of usage before I found out about P20 and then downgraded. I didn't have any problems with P20 like others were seeing. -Chip On Wed, Mar 11,

Re: [OmniOS-discuss] lsi sas 9211-8i it efi firmware 20.00.02.00

On Tue, Mar 10, 2015 at 5:48 AM, Stephan Budach stephan.bud...@jvm.de wrote: Am 09.03.15 um 15:47 schrieb Dan McDonald: On Mar 9, 2015, at 10:23 AM, Eric Sproul eric.spr...@circonus.com wrote: On Sat, Mar 7, 2015 at 3:56 PM, Brogyányi József bro...@gmail.com wrote: Has anyone tested this

Re: [OmniOS-discuss] smtp-notify dependency on sendmail

On Tue, Mar 10, 2015 at 10:36 AM, Dan McDonald dan...@omniti.com wrote: svccfg -s system/fm/smtp-notify setprop startup_req/entities = fmri: svc:/milestone/multi-user:default svccfg -s system/fm/smtp-notify addpropvalue startup_req/entities fmri: svc:/system/fmd:default That's the trick.

[OmniOS-discuss] smtp-notify dependency on sendmail

I haven't used sendmail since the 1990's and don't intend to change. I've figured out how to get smtp-notify to start with sendmail-client disable, but it was a manual process of using 'svccfg -s smtp-notify editprop' What I can't figure out how to do the same on the command line. Everything I

Re: [OmniOS-discuss] best or preferred 10g card for OmniOS

On Sun, Mar 29, 2015 at 8:51 AM, Matthew Lagoe matthew.la...@subrigo.net wrote: The intel cards are nice but they don't have any cx4 cards so we don't use them. Copper connections have less latency on short links then fiber as you don't have the electric to optical conversion (when done

Re: [OmniOS-discuss] OmniOS on IBM DX360 UEFI Firmware

Sounds like the problem I had on a new Supermicro box. I found by trial and error turning off x2apic in the bios fixed the problem. Also disable C sleep states. -Chip On Wed, Mar 4, 2015 at 10:27 AM, John Barfield john.barfi...@bissinc.com wrote: Greetings, I’m writing to see if

Re: [OmniOS-discuss] speeding up file access

No USB flash is going to bring any benefit to the game as a log device. If it has any ram cache to increase write performance, it's useless as a log device because it will not have any power protection for the ram. Most likely it will not have any RAM and write performance will be poor. Decent

Re: [OmniOS-discuss] OmniOS Bloody update for Feb 18

several OmniOS VMs already. At least 1/2 of them need VMware tools. -Chip Dan Sent from my iPhone (typos, autocorrect, and all) On Feb 20, 2015, at 9:20 AM, Schweiss, Chip c...@innovates.com wrote: I will second that request as my OmniOS experiments always start as VMware VMs. -Chip

Re: [OmniOS-discuss] The ixgbe driver, Lindsay Lohan, and the Greek economy

I can't say I totally agree with your performance assessment. I run Intel X520 in all my OmniOS boxes. Here is a capture of nfssvrtop I made while running many storage vMotions between two OmniOS boxes hosting NFS datastores. This is a 10 host VMware cluster. Both OmniOS boxes are dual 10G

Re: [OmniOS-discuss] slow ssh login, maybee to many locales?

Slow ssh logon is almost always reverse DNS problems on the server side. Adding the client to the server's /etc/hosts will usually resolve the problem. -Chip On Sat, Apr 18, 2015 at 10:37 PM, PÁSZTOR György pasz...@sagv5.gyakg.u-szeged.hu wrote: Hi, I faced with that, the login onto my new

Re: [OmniOS-discuss] What repos do people use to build a *AMP server?

I've done really well with the OpenCSW packages on OmniOS. -Chip On May 8, 2015 11:50 AM, Saso Kiselkov skiselkov...@gmail.com wrote: I've decided to try and update my r151006 box to something newer, seeing as r151014 just came out and it's supposed to be LTS. Trouble is, I'm trying to build

Re: [OmniOS-discuss] High density 2.5 chassis

I have an SSD server in one of those chassis. Here's a write-up about it on my blog, there are 3 postings about it. http://www.bigdatajunkie.com/index.php/9-solaris/zfs/10-short-stroking-consumer-ssds Not necessarily a build for everyone, but it has been absolutely awesome for our use. After a

Re: [OmniOS-discuss] esxi 5.5 to omnios r151014 nfs server issue

On Mon, Apr 6, 2015 at 9:30 AM, Dan McDonald dan...@omniti.com wrote: On Apr 6, 2015, at 5:50 AM, Hafiz Rafiyev rafibe...@gmail.com wrote: only log I see from omnios side is: nfs4cbd[468]: [ID 867284 daemon.notice] nfsv4 cannot determine local hostname binding for transport tcp6 -

Re: [OmniOS-discuss] Fwd: All SSD pool advice

On Mon, Apr 6, 2015 at 8:53 AM, Fábio Rabelo fa...@fabiorabelo.wiki.br wrote: Sorry, forget to forward to the list ... -- Forwarded message -- From: Fábio Rabelo fa...@fabiorabelo.wiki.br Date: 2015-04-06 10:51 GMT-03:00 Subject: Re: [OmniOS-discuss] All SSD pool advice

Re: [OmniOS-discuss] All SSD pool advice

On Mon, Apr 6, 2015 at 8:41 AM, Chris Nagele nag...@wildbit.com wrote: Thanks everyone. Regarding the expanders, our 4U servers are on the following chassis: http://www.supermicro.com/products/chassis/4U/846/SC846E16-R1200.cfm We are using all SAS disks, except for the SSDs. How big is the

Re: [OmniOS-discuss] Best infrastructure for VSphere/Hyper-V

On Apr 2, 2015 11:50 AM, Nate Smith nsm...@careyweb.com wrote: So going over the forum over the last month, it appears more than a couple people have had problem with Omnios as a storage backend for virtualization platforms, both as iSCSI targets and as Fibre Channel targets. Looking at a list

Re: [OmniOS-discuss] Zpool export while resilvering?

On Wed, Jun 10, 2015 at 4:09 AM, Robert A. Brock robert.br...@2hoffshore.com wrote: What did you use to flash them? Fwflash just gives an error about firmware file being too large. Santools. -Chip *From:* Schweiss, Chip [mailto:c...@innovates.com] *Sent:* 09 June 2015 21:25

Re: [OmniOS-discuss] Zpool export while resilvering?

I went through this problem a while back. There are some gotchas in getting them back online and firmware upgraded. The is will not talk to the drive until it has its firmware upgraded or cleared from the fault database. This drives will not flash with multipath enabled either. I ended up

Re: [OmniOS-discuss] Backing up HUGE zfs volumes

I would caution against anything using 'zfs diff' It has been perpetually broken, either not working at all, or returning incomplete information. Avoiding crawling the directory is pretty much impossible unless you use 'zfs send'. However, as long as there is enough cache on the system,

Re: [OmniOS-discuss] Highly Available ZFS

On Mon, Jun 29, 2015 at 1:52 PM, Michael Rasmussen m...@miras.org wrote: Does anybody have an idea of how Nexenta does their HA-setup? My guess is that it must involve something with a constant snapshot of the pool using zfs send combined with forced import. Nexenta uses RSF-1 from

Re: [OmniOS-discuss] Slow Drive Detection and boot-archive

, 2015, at 7:51 AM, Schweiss, Chip c...@innovates.com wrote: On Fri, Jul 24, 2015 at 5:03 PM, Michael Talbott mtalb...@lji.org wrote: Hi, I've downgraded the cards (LSI 9211-8e) to v.19 and disabled their boot bios. But I'm still getting the 8 second per drive delay after the kernel loads

Re: [OmniOS-discuss] Slow Drive Detection and boot-archive

On Fri, Jul 24, 2015 at 5:03 PM, Michael Talbott mtalb...@lji.org wrote: Hi, I've downgraded the cards (LSI 9211-8e) to v.19 and disabled their boot bios. But I'm still getting the 8 second per drive delay after the kernel loads. Any other ideas? 8 seconds is way too long. What JBODs and

Re: [OmniOS-discuss] big zfs storage?

in smaller disk failure parameters, so disks fail quicker, was a big help when something does go wrong with a disk. thanks, liam On Fri, Jul 10, 2015 at 10:31 AM, Schweiss, Chip c...@innovates.com wrote: Unfortunately for the past couple years panics on disk failure has been the norm. All my

Re: [OmniOS-discuss] Zil Device

The 850 Pro should never be used as a log device. It does not have power fail protection of its ram cache. You might as well set sync=disabled and skip using a log device entirely because the 850 Pro is not protecting your last transactions in case of power failure. Only SSDs with power

Re: [OmniOS-discuss] re-tune round-robin reading from a mirror

This is a very interesting idea. It could allow for the creation of a scratch pool with great ROI. I have a particular need for an extremely high read rate pool for data analysis that will leverage the fattest read optimized SSDs I can get for the dollar. I was considering this to be raidz1,

Re: [OmniOS-discuss] Slow performance with ZeusRAM?

The ZIL on log devices suffer a bit from not filling queues well. In order to get the queues to fill more, try running your test to several zfs folders on the pool simultaneously and measure your total I/O. As I understand it, ff you're writing to only one zfs folder, your queue depth will stay

Re: [OmniOS-discuss] Updates for OmniOS r151014 & r151016

On Fri, Nov 13, 2015 at 2:13 PM, Dan McDonald wrote: > > 014: > -- > > - OpenSSH 7.1p1, including the r151016 method(s) of changing between > SunSSH and OpenSSH > > Thank you for this!! -Chip > > Happy updating! > Dan > ___

Re: [OmniOS-discuss] ZIL TXG commits happen very frequently - why?

It all has to do with the write throttle and buffers filling. Here's a great blog post on how it works and how it's tuned: http://dtrace.org/blogs/ahl/2014/02/10/the-openzfs-write-throttle/ http://dtrace.org/blogs/ahl/2014/08/31/openzfs-tuning/ -Chip On Wed, Oct 14, 2015 at 12:45 AM, Rune

Re: [OmniOS-discuss] zfs send/receive corruption?

This smells of a problem reported fixed on FreeBSD and ZoL. http://permalink.gmane.org/gmane.comp.file-systems.openzfs.devel/1545 On the Illumos ZFS the question was posed if the fixed have been incorporated, but unanswered:

Re: [OmniOS-discuss] big zfs storage?

Linda, I have 3.5 PB running under OmniOS. All my systems have LSI 2108 HBAs which is considered the best choice for HBAs. Illumos leaves a bit to be desired with handling faults from disks or SAS problems, but things under OmniOS have been improving, much thanks to Dan McDonald and OmniTI.

Re: [OmniOS-discuss] big zfs storage?

? linda On 7/9/15 9:30 PM, Schweiss, Chip wrote: Linda, I have 3.5 PB running under OmniOS. All my systems have LSI 2108 HBAs which is considered the best choice for HBAs. Illumos leaves a bit to be desired with handling faults from disks or SAS problems, but things under OmniOS have

[OmniOS-discuss] Periodic SSH connect failures

On OmniOS r151014 I use ssh with rsa-keys to allow my storage systems to communicate and launch things like 'zfs receive' Periodically the connection fails with "ssh_exchange_identification: Connection closed by remote host" When this happens about 1/2 the connection attempts will fail this way

Re: [OmniOS-discuss] r151014 users - beware of illumos 6214 and L2ARC

On Thu, Sep 10, 2015 at 11:43 AM, Dan McDonald <dan...@omniti.com> wrote: > > > On Sep 10, 2015, at 12:15 PM, Schweiss, Chip <c...@innovates.com> wrote: > > > > Is this limited to r151014 and bloody? > > > > I was under the impression this bug went ba

Re: [OmniOS-discuss] r151014 users - beware of illumos 6214 and L2ARC

Is this limited to r151014 and bloody? I was under the impression this bug went back to the introduction of L2ARC compression. -Chip On Thu, Sep 10, 2015 at 6:53 AM, Dan McDonald wrote: > > > On Sep 10, 2015, at 7:53 AM, Dan McDonald wrote: > > > > If

Re: [OmniOS-discuss] possible bug

I've seen issues like this when you run out of NFS locks. NFSv3 in Illumos is really slow at releasing locks. On all my NFS servers I do: sharectl set -p lockd_listen_backlog=256 nfs sharectl set -p lockd_servers=2048 nfs Everywhere I can, I use NFSv4 instead of v3. It handles lock much

[OmniOS-discuss] NFS Server restart

I had an NFS server become unresponsive on one of my production systems. The NFS server service would not restart, out of desperation I rebooted which fixed the problem. Before reboot I tried restarting all NFS related service with no-avail. The reboot probably wasn't necessary but the correct

Re: [OmniOS-discuss] Updating to r15016

On Wed, Feb 10, 2016 at 11:19 AM, Dale Ghent <da...@omniti.com> wrote: > > > On Feb 10, 2016, at 11:26 AM, Schweiss, Chip <c...@innovates.com> wrote: > > > > I'm updating one of my systems to r151016. When I use: > > > > /usr/bin/pkg update --b

[OmniOS-discuss] Updating to r15016

I'm updating one of my systems to r151016. When I use: /usr/bin/pkg update --be-name=omnios-r151016 entire@11,5.11-0.151016 I get: pkg update: 'entire@11,5.11-0.151016' matches no installed packages I'm ignorant of what the entire@ portion does as I've been script kidding my way through

Re: [OmniOS-discuss] Updating to r15016

On Wed, Feb 10, 2016 at 1:11 PM, Dan McDonald <dan...@omniti.com> wrote: > > > On Feb 10, 2016, at 11:26 AM, Schweiss, Chip <c...@innovates.com> wrote: > > > > /usr/bin/pkg update --be-name=omnios-r151016 entire@11,5.11-0.151016 > > Lose the "5."

[OmniOS-discuss] zlib/zlib-devel packages

Is anyone aware of zlib and zlib-devel packages available anywhere for OmniOS? These are needed for building any Samba version 4.2.0 or greater. Thanks! -Chip ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com

Re: [OmniOS-discuss] zlib/zlib-devel packages

On Wed, Jan 20, 2016 at 1:02 PM, Peter Tribble <peter.trib...@gmail.com> wrote: > On Wed, Jan 20, 2016 at 6:40 PM, Schweiss, Chip <c...@innovates.com> > wrote: > >> Is anyone aware of zlib and zlib-devel packages available anywhere for >> OmniOS? >> > &g

Re: [OmniOS-discuss] zlib/zlib-devel packages

On Wed, Jan 20, 2016 at 2:03 PM, Dan McDonald wrote: > Probably not useful now for you on LTS, but Nexenta's SMB2 is available > for r151016 and later. > My biggest challenge is I have to support multiple domains on one server. That's forcing me to build from source because

Re: [OmniOS-discuss] zlib/zlib-devel packages

var \ > --bundled-libraries=ALL \ > --with-winbind \ > --with-ads \ > --with-ldap \ > --with-pam \ > --with-iconv \ > --with-acl-support \ > --with-syslog \ > --with-aio-support \ > --enable-fhs \ > --without-ad-dc \ > > --with-

Re: [OmniOS-discuss] Testing RSF-1 with zpool/nfs HA

On Thu, Feb 18, 2016 at 3:56 PM, Richard Elling < richard.ell...@richardelling.com> wrote: > > > Related to lock manager is name lookup. If you use name services, you add > a latency > dependency to failover for name lookups, which is why we often disable DNS > or other > network name services on

Re: [OmniOS-discuss] Routing challlenges

t;mtalb...@lji.org> wrote: > > It sounds like you're using the same subnet for management and service > traffic, that would be the problem causing the split route. Give each vlan > a unique subnet and traffic should flow correctly. > > Michael > Sent from my iPhon

[OmniOS-discuss] sshd logging

I'm trying to get sshd logging to work on OmniOS with OpenSSH installed. Nothing I try seems to produce any logging. In sshd_config I have: # Syslog facility and level SyslogFacility AUTH LogLevel VERBOSE In /etc/syslog.conf: *.err;kern.notice;auth.notice /dev/sysmsg

Re: [OmniOS-discuss] Supermicro X9DR3-F PCI Bus reported fault.

I've run many Supermicro servers in the X9 and X10 series. It sounds like you have a bad board, or at the minimum a bad slot. If it's under warranty get it exchanged. -Chip On Tue, Apr 26, 2016 at 9:47 PM, Shaun McGuane wrote: > Hi OmniOS list, > > I am wondering if

Re: [OmniOS-discuss] Multiple faulty SSD's ?

I don't have a lot of experience with the 850 Pro, but a lot with the 840 Pro under OmniOS With 4K block size set in sd.conf and slicing them to only use 80% of their capacity a pool of 72 of them has been under near constant heavy read/write workload for over 3 years without a single chksum

Re: [OmniOS-discuss] Corrupted file recovery and restoring pool to ONLINE

To get back to an online state you need to detach the offline disk: zpool detach B-034 c10t5C0F0132772Ed0s0 If the corrupted file is in any snapshots those snapshots will have to be destroyed to stop it from being found as a corruption during a scrub. -Chip On Mon, Jan 23, 2017 at 9:53 AM,

Re: [OmniOS-discuss] Network >10Gb/s

On Tue, Jan 10, 2017 at 9:58 AM, Dan McDonald <dan...@omniti.com> wrote: > > > On Jan 10, 2017, at 8:41 AM, Schweiss, Chip <c...@innovates.com> wrote: > > > > It appears that my options for 40Gb/s Ethernet are Intel, Chelsio and > SolarFlare.

[OmniOS-discuss] Network >10Gb/s

It appears that my options for 40Gb/s Ethernet are Intel, Chelsio and SolarFlare. Can anyone comment on which of these is the most stable solution when running under OmniOS? What's the fastest NFS throughput you've been able to achieve? Also is there any work being done by anyone to bring an

Re: [OmniOS-discuss] new supermicro server

On Wed, Mar 8, 2017 at 8:36 AM, Bob Friesenhahn < bfrie...@simple.dallas.tx.us> wrote: > > > Perhaps there is a way to tell the HBA BIOS to not advertize the SAS > drives which are not needed for booting? In the HBA BIOS configuration, set the HBA to disabled. OmniOS will still see the HBA and

[OmniOS-discuss] Resilver zero progress

I have a pool that has had a resilver running for about an hour but the progress status is a bit alarming. I'm concerned for some reason it will not resilver. Resilvers are tuned to be faster in /etc/system. This is on OmniOS r151014, currently fully updated. Any suggestions? -Chip from

  1   2   >