With ESXi 6.0 I have had NFS problems as well. You should use at least 6.0U2(or 6.5.0d with the 6.5 line)

Another problem may be timeouts. ZFS will wait longer for a disk than ESXi for NFS. What you can do is reducing disk timeout time in /etc/system with set sd:sd_io_time=0xF (=15s, default is 60s). Check system-logs for disk related problems (/var/adm/messages).

You should also use vmxnet3s for OmniOS with increased buffer settings for vmxnet3, tcp and NFS for 10G networking.Snaps and replication itself are uncritical as long as you do not have disk or network problems. Ex MTU 9000 can give problems. Enough RAM may be another item. You should give 8GB or more to OmniOS.


Gea
napp-it


Am 23.06.2017 um 08:59 schrieb Oliver Weinmann:

Hi,

We have a hyperconverged setup.

ESXi 6.0 -> OmniOS VM -> Storage Passthrough. The 10GB Nics are in configured in Active / Standby. For NFS I use a dedicated /24 VLAN.

I wonder if ZFS replication or snapshotting could be the reason for the problems we are seeing. The system fails at night time. We have several auto-sync jobs from a Nexenta system to this system. I have now disabled these jobs. I just wonder where logs etc. I can find any information on what is going on on the system when it fails.

The symtoms are always the same. The vmware nfsshare disappear. So I just reshare them (nfs set nfsshare=…. /hgst4u60/vmware-ds-1. Then the root ZFS folders of all local drives that I think have snapshots enabled are unmounted. So I have to unmount them all hard and remount them. Also the root ZFS folders from replicated ZFS folders are unmounted. This is why I assume that there is a link between the problems and auto-sync or snapshotting.

*Oliver Weinmann*
Senior Unix VMWare, Storage Engineer

Telespazio VEGA Deutschland GmbH
Europaplatz 5 - 64293 Darmstadt - Germany
Ph: + 49 (0)6151 8257 744 | Fax: +49 (0)6151 8257 799
oliver.weinm...@telespazio-vega.de <mailto:oliver.weinm...@telespazio-vega.de>
http://www.telespazio-vega.de

Registered office/Sitz: Darmstadt, Register court/Registergericht: Darmstadt, HRB 89231; Managing Director/Geschäftsführer: Sigmar Keller

*From:*Lawrence Giam [mailto:paladinemisha...@gmail.com]
*Sent:* Freitag, 23. Juni 2017 05:00
*To:* Oliver Weinmann <oliver.weinm...@telespazio-vega.de>
*Subject:* Re: [OmniOS-discuss] Loosing NFS shares

Hi Oliver,

What is your network setup in relationship to NFS file server and VM Host? Is your backdone using 10Gbe network and are they setup with redundancy (eg. MLAG)?

Regards.

On Thu, Jun 22, 2017 at 2:45 PM, Oliver Weinmann <oliver.weinm...@telespazio-vega.de <mailto:oliver.weinm...@telespazio-vega.de>> wrote:

    Hi,

    we are using OmniOS for a few months now and have big trouble with
    stability. We mainly use it for VMware NFS datastores. The last 3
    nights we lost all NFS datastores and VMs stopped running. I
    noticed that even though zfs get sharenfs shows folders as shared
    they become inaccessible. Setting sharenfs to off and sharing
    again solves the issue. I have no clue where to start. I’m fairly
    new to OmniOS.

    Any help would be highly appreciated.

    Thanks and Best Regards,

    Oliver

    *Oliver Weinmann*
    Senior Unix VMWare, Storage Engineer

    Telespazio VEGA Deutschland GmbH
    Europaplatz 5 - 64293 Darmstadt - Germany
    Ph: + 49 (0)6151 8257 744 <tel:+49%206151%208257744> | Fax: +49
    (0)6151 8257 799 <tel:+49%206151%208257799>
    oliver.weinm...@telespazio-vega.de
    <mailto:oliver.weinm...@telespazio-vega.de>
    http://www.telespazio-vega.de

    Registered office/Sitz: Darmstadt, Register court/Registergericht:
    Darmstadt, HRB 89231; Managing Director/Geschäftsführer: Sigmar Keller


    _______________________________________________
    OmniOS-discuss mailing list
    OmniOS-discuss@lists.omniti.com
    <mailto:OmniOS-discuss@lists.omniti.com>
    http://lists.omniti.com/mailman/listinfo/omnios-discuss



_______________________________________________
OmniOS-discuss mailing list
OmniOS-discuss@lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss

--

_______________________________________________
OmniOS-discuss mailing list
OmniOS-discuss@lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss

Reply via email to