Re: [OmniOS-discuss] Loosing NFS shares
With ESXi 6.0 I have had NFS problems as well. You should use at least 6.0U2(or 6.5.0d with the 6.5 line) Another problem may be timeouts. ZFS will wait longer for a disk than ESXi for NFS. What you can do is reducing disk timeout time in /etc/system with set sd:sd_io_time=0xF (=15s, default is 60s). Check system-logs for disk related problems (/var/adm/messages). You should also use vmxnet3s for OmniOS with increased buffer settings for vmxnet3, tcp and NFS for 10G networking.Snaps and replication itself are uncritical as long as you do not have disk or network problems. Ex MTU 9000 can give problems. Enough RAM may be another item. You should give 8GB or more to OmniOS. Gea napp-it Am 23.06.2017 um 08:59 schrieb Oliver Weinmann: Hi, We have a hyperconverged setup. ESXi 6.0 -> OmniOS VM -> Storage Passthrough. The 10GB Nics are in configured in Active / Standby. For NFS I use a dedicated /24 VLAN. I wonder if ZFS replication or snapshotting could be the reason for the problems we are seeing. The system fails at night time. We have several auto-sync jobs from a Nexenta system to this system. I have now disabled these jobs. I just wonder where logs etc. I can find any information on what is going on on the system when it fails. The symtoms are always the same. The vmware nfsshare disappear. So I just reshare them (nfs set nfsshare=…. /hgst4u60/vmware-ds-1. Then the root ZFS folders of all local drives that I think have snapshots enabled are unmounted. So I have to unmount them all hard and remount them. Also the root ZFS folders from replicated ZFS folders are unmounted. This is why I assume that there is a link between the problems and auto-sync or snapshotting. *Oliver Weinmann* Senior Unix VMWare, Storage Engineer Telespazio VEGA Deutschland GmbH Europaplatz 5 - 64293 Darmstadt - Germany Ph: + 49 (0)6151 8257 744 | Fax: +49 (0)6151 8257 799 oliver.weinm...@telespazio-vega.de <mailto:oliver.weinm...@telespazio-vega.de> http://www.telespazio-vega.de Registered office/Sitz: Darmstadt, Register court/Registergericht: Darmstadt, HRB 89231; Managing Director/Geschäftsführer: Sigmar Keller *From:*Lawrence Giam [mailto:paladinemisha...@gmail.com] *Sent:* Freitag, 23. Juni 2017 05:00 *To:* Oliver Weinmann <oliver.weinm...@telespazio-vega.de> *Subject:* Re: [OmniOS-discuss] Loosing NFS shares Hi Oliver, What is your network setup in relationship to NFS file server and VM Host? Is your backdone using 10Gbe network and are they setup with redundancy (eg. MLAG)? Regards. On Thu, Jun 22, 2017 at 2:45 PM, Oliver Weinmann <oliver.weinm...@telespazio-vega.de <mailto:oliver.weinm...@telespazio-vega.de>> wrote: Hi, we are using OmniOS for a few months now and have big trouble with stability. We mainly use it for VMware NFS datastores. The last 3 nights we lost all NFS datastores and VMs stopped running. I noticed that even though zfs get sharenfs shows folders as shared they become inaccessible. Setting sharenfs to off and sharing again solves the issue. I have no clue where to start. I’m fairly new to OmniOS. Any help would be highly appreciated. Thanks and Best Regards, Oliver *Oliver Weinmann* Senior Unix VMWare, Storage Engineer Telespazio VEGA Deutschland GmbH Europaplatz 5 - 64293 Darmstadt - Germany Ph: + 49 (0)6151 8257 744 <tel:+49%206151%208257744> | Fax: +49 (0)6151 8257 799 <tel:+49%206151%208257799> oliver.weinm...@telespazio-vega.de <mailto:oliver.weinm...@telespazio-vega.de> http://www.telespazio-vega.de Registered office/Sitz: Darmstadt, Register court/Registergericht: Darmstadt, HRB 89231; Managing Director/Geschäftsführer: Sigmar Keller ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com <mailto:OmniOS-discuss@lists.omniti.com> http://lists.omniti.com/mailman/listinfo/omnios-discuss ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss -- ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] Loosing NFS shares
Hi Dan, Thanks for pointing this out. No the service is not running: svcs -a | grep cap Oliver Weinmann Senior Unix VMWare, Storage Engineer Telespazio VEGA Deutschland GmbH Europaplatz 5 - 64293 Darmstadt - Germany Ph: + 49 (0)6151 8257 744 | Fax: +49 (0)6151 8257 799 oliver.weinm...@telespazio-vega.de http://www.telespazio-vega.de Registered office/Sitz: Darmstadt, Register court/Registergericht: Darmstadt, HRB 89231; Managing Director/Geschäftsführer: Sigmar Keller-Original Message- From: Dan McDonald [mailto:dan...@kebe.com] Sent: Donnerstag, 22. Juni 2017 14:10 To: Oliver Weinmann <oliver.weinm...@telespazio-vega.de>; Dan McDonald <dan...@kebe.com> Cc: Tobias Oetiker <t...@oetiker.ch>; omnios-discuss <omnios-discuss@lists.omniti.com> Subject: Re: [OmniOS-discuss] Loosing NFS shares > On Jun 22, 2017, at 3:13 AM, Oliver Weinmann > <oliver.weinm...@telespazio-vega.de> wrote: > > Hi, > > Don’t think so: > > svcs -vx rcapd > > shows nothing. You're not looking for the right thing. neuromancer(~)[0]% pgrep rcapd 340 neuromancer(~)[0]% svcs -a | grep cap online May_12 svc:/system/rcap:default neuromancer(~)[0]% svcs -xv rcap svc:/system/rcap:default (resource capping daemon) State: online since Fri May 12 02:12:40 2017 See: man -M /usr/share/man -s 1M rcapd See: man -M /usr/share/man -s 1M rcapstat See: man -M /usr/share/man -s 1M rcapadm See: /var/svc/log/system-rcap:default.log Impact: None. neuromancer(~)[0]% su troot Password: OmniOS 5.11 omnios-r151022-f9693432c2 May 2017 (0)# svcadm disable rcap (0)# Hope this helps, Dan ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] Loosing NFS shares
> On Jun 22, 2017, at 3:13 AM, Oliver Weinmann >wrote: > > Hi, > > Don’t think so: > > svcs -vx rcapd > > shows nothing. You're not looking for the right thing. neuromancer(~)[0]% pgrep rcapd 340 neuromancer(~)[0]% svcs -a | grep cap online May_12 svc:/system/rcap:default neuromancer(~)[0]% svcs -xv rcap svc:/system/rcap:default (resource capping daemon) State: online since Fri May 12 02:12:40 2017 See: man -M /usr/share/man -s 1M rcapd See: man -M /usr/share/man -s 1M rcapstat See: man -M /usr/share/man -s 1M rcapadm See: /var/svc/log/system-rcap:default.log Impact: None. neuromancer(~)[0]% su troot Password: OmniOS 5.11 omnios-r151022-f9693432c2 May 2017 (0)# svcadm disable rcap (0)# Hope this helps, Dan ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] Loosing NFS shares
Hi, Running the zfs mount –a from / shows the same errors. I now ran the following commands to correct the mountpoints: Re-enable inheritance: zfs inherit -r mountpoint hgst4u60/ReferencePR Reset mountpoint on the root folder: zfs set mountpoint=/hgst4u60/ReferencePR hgst4u60/ReferencePR unmount all subfolders: for fs in `zfs mount | grep ReferencePR | awk '{print $2}'`; do zfs unmount $fs; done Check that all subfolders are unmounted: zfs mount | grep ReferencePR Check that all folders are empty, just to be sure!!!: du /hgst4u60/ReferencePR If they are empty remove the root folder: rm -rf /hgst4u60/ReferencePR Finally remount: zfs mount –a This solves the mount issues but I wonder why this has happened? And hopefully this doesn’t happen again? [cid:Logo_Telespazio_180_px_signature_eng_b58fa623-e26d-4116-9230-766adacfe55e1.png] Oliver Weinmann Senior Unix VMWare, Storage Engineer Telespazio VEGA Deutschland GmbH Europaplatz 5 - 64293 Darmstadt - Germany Ph: + 49 (0)6151 8257 744 | Fax: +49 (0)6151 8257 799 oliver.weinm...@telespazio-vega.de<mailto:oliver.weinm...@telespazio-vega.de> http://www.telespazio-vega.de Registered office/Sitz: Darmstadt, Register court/Registergericht: Darmstadt, HRB 89231; Managing Director/Geschäftsführer: Sigmar Keller From: Sriram Narayanan [mailto:sriram...@gmail.com] Sent: Donnerstag, 22. Juni 2017 10:26 To: Oliver Weinmann <oliver.weinm...@telespazio-vega.de> Cc: Stephan Budach <stephan.bud...@jvm.de>; omnios-discuss <omnios-discuss@lists.omniti.com> Subject: Re: [OmniOS-discuss] Loosing NFS shares On Thu, Jun 22, 2017 at 3:45 PM, Oliver Weinmann <oliver.weinm...@telespazio-vega.de<mailto:oliver.weinm...@telespazio-vega.de>> wrote: One more thing I just noticed is that the system seems to be unable to mount directories: root@omnios01:/hgst4u60/ReferenceAC/AGDEMO# /usr/sbin/zfs mount -a cannot mount '/hgst4u60/ReferenceAC': directory is not empty cannot mount '/hgst4u60/ReferenceDF': directory is not empty cannot mount '/hgst4u60/ReferenceGI': directory is not empty cannot mount '/hgst4u60/ReferenceJL': directory is not empty cannot mount '/hgst4u60/ReferenceMO': directory is not empty cannot mount '/hgst4u60/ReferencePR': directory is not empty cannot mount '/hgst4u60/ReferenceSU': directory is not empty cannot mount '/hgst4u60/ReferenceVX': directory is not empty cannot mount '/hgst4u60/ReferenceYZ': directory is not empty Maybe this is where all problems are coming from? Please issue the zfs mount -a command from elsewhere rather than from within "/hgst4u60/ReferenceAC" It also seems that "" and the others may already have local files. If possible, then rename those Reference* directories and issue the zfs mount -a again. From: Stephan Budach [mailto:stephan.bud...@jvm.de<mailto:stephan.bud...@jvm.de>] Sent: Donnerstag, 22. Juni 2017 09:30 To: Oliver Weinmann <oliver.weinm...@telespazio-vega.de<mailto:oliver.weinm...@telespazio-vega.de>> Cc: omnios-discuss <omnios-discuss@lists.omniti.com<mailto:omnios-discuss@lists.omniti.com>> Subject: Re: [OmniOS-discuss] Loosing NFS shares Hi Oliver, Von: "Oliver Weinmann" <oliver.weinm...@telespazio-vega.de<mailto:oliver.weinm...@telespazio-vega.de>> An: "Tobias Oetiker" <t...@oetiker.ch<mailto:t...@oetiker.ch>> CC: "omnios-discuss" <omnios-discuss@lists.omniti.com<mailto:omnios-discuss@lists.omniti.com>> Gesendet: Donnerstag, 22. Juni 2017 09:13:27 Betreff: Re: [OmniOS-discuss] Loosing NFS shares Hi, Don’t think so: svcs -vx rcapd shows nothing. [cid:image001.png@01D2EB3B.A023E330] Oliver Weinmann Senior Unix VMWare, Storage Engineer Telespazio VEGA Deutschland GmbH Europaplatz 5 - 64293 Darmstadt - Germany Ph: + 49 (0)6151 8257 744<tel:+49%206151%208257744> | Fax: +49 (0)6151 8257 799<tel:+49%206151%208257799> oliver.weinm...@telespazio-vega.de<mailto:oliver.weinm...@telespazio-vega.de> http://www.telespazio-vega.de Registered office/Sitz: Darmstadt, Register court/Registergericht: Darmstadt, HRB 89231; Managing Director/Geschäftsführer: Sigmar Keller From: Tobias Oetiker [mailto:t...@oetiker.ch] Sent: Donnerstag, 22. Juni 2017 09:11 To: Oliver Weinmann <oliver.weinm...@telespazio-vega.de<mailto:oliver.weinm...@telespazio-vega.de>> Cc: omnios-discuss <omnios-discuss@lists.omniti.com<mailto:omnios-discuss@lists.omniti.com>> Subject: Re: [OmniOS-discuss] Loosing NFS shares Oliver, are you running rcapd ? we found that (at least of the box) this thing wrecks havoc to both nfs and iscsi sharing ... cheers tobi - On Jun 22, 2017, at 8:45 AM, Oliver Weinmann <oliver.weinm...@telespazio-vega.de<mailto:oliver.weinm...@telespazio-vega.de>> wrote: Hi, we are using OmniOS for a few months now and have big tr
Re: [OmniOS-discuss] Loosing NFS shares
On Thu, Jun 22, 2017 at 3:45 PM, Oliver Weinmann < oliver.weinm...@telespazio-vega.de> wrote: > One more thing I just noticed is that the system seems to be unable to > mount directories: > > > > root@omnios01:/hgst4u60/ReferenceAC/AGDEMO# /usr/sbin/zfs mount -a > > cannot mount '/hgst4u60/ReferenceAC': directory is not empty > > cannot mount '/hgst4u60/ReferenceDF': directory is not empty > > cannot mount '/hgst4u60/ReferenceGI': directory is not empty > > cannot mount '/hgst4u60/ReferenceJL': directory is not empty > > cannot mount '/hgst4u60/ReferenceMO': directory is not empty > > cannot mount '/hgst4u60/ReferencePR': directory is not empty > > cannot mount '/hgst4u60/ReferenceSU': directory is not empty > > cannot mount '/hgst4u60/ReferenceVX': directory is not empty > > cannot mount '/hgst4u60/ReferenceYZ': directory is not empty > > > > Maybe this is where all problems are coming from? > Please issue the zfs mount -a command from elsewhere rather than from within "/hgst4u60/ReferenceAC" It also seems that "" and the others may already have local files. If possible, then rename those Reference* directories and issue the zfs mount -a again. > > > *From:* Stephan Budach [mailto:stephan.bud...@jvm.de] > *Sent:* Donnerstag, 22. Juni 2017 09:30 > *To:* Oliver Weinmann <oliver.weinm...@telespazio-vega.de> > *Cc:* omnios-discuss <omnios-discuss@lists.omniti.com> > *Subject:* Re: [OmniOS-discuss] Loosing NFS shares > > > > Hi Oliver, > > > -- > > *Von: *"Oliver Weinmann" <oliver.weinm...@telespazio-vega.de> > *An: *"Tobias Oetiker" <t...@oetiker.ch> > *CC: *"omnios-discuss" <omnios-discuss@lists.omniti.com> > *Gesendet: *Donnerstag, 22. Juni 2017 09:13:27 > *Betreff: *Re: [OmniOS-discuss] Loosing NFS shares > > > > Hi, > > > > Don’t think so: > > > > svcs -vx rcapd > > > > shows nothing. > > > > > > [image: cid:image001.png@01D2EB3B.A023E330] > > *Oliver Weinmann* > Senior Unix VMWare, Storage Engineer > > Telespazio VEGA Deutschland GmbH > Europaplatz 5 - 64293 Darmstadt - Germany > Ph: + 49 (0)6151 8257 744 <+49%206151%208257744> | Fax: +49 (0)6151 8257 > 799 <+49%206151%208257799> > oliver.weinm...@telespazio-vega.de > http://www.telespazio-vega.de > > Registered office/Sitz: Darmstadt, Register court/Registergericht: > Darmstadt, HRB 89231; Managing Director/Geschäftsführer: Sigmar Keller > > *From:* Tobias Oetiker [mailto:t...@oetiker.ch <t...@oetiker.ch>] > *Sent:* Donnerstag, 22. Juni 2017 09:11 > *To:* Oliver Weinmann <oliver.weinm...@telespazio-vega.de> > *Cc:* omnios-discuss <omnios-discuss@lists.omniti.com> > *Subject:* Re: [OmniOS-discuss] Loosing NFS shares > > > > Oliver, > > > > are you running rcapd ? we found that (at least of the box) this thing > wrecks havoc to both > > nfs and iscsi sharing ... > > > > cheers > > tobi > > > > - On Jun 22, 2017, at 8:45 AM, Oliver Weinmann < > oliver.weinm...@telespazio-vega.de> wrote: > > Hi, > > > > we are using OmniOS for a few months now and have big trouble with > stability. We mainly use it for VMware NFS datastores. The last 3 nights we > lost all NFS datastores and VMs stopped running. I noticed that even though > zfs get sharenfs shows folders as shared they become inaccessible. Setting > sharenfs to off and sharing again solves the issue. I have no clue where to > start. I’m fairly new to OmniOS. > > > > Any help would be highly appreciated. > > > > Thanks and Best Regards, > > Oliver > > > > [image: cid:image001.png@01D2EB3B.A023E330] > > *Oliver Weinmann* > Senior Unix VMWare, Storage Engineer > > Telespazio VEGA Deutschland GmbH > Europaplatz 5 - 64293 Darmstadt - Germany > Ph: + 49 (0)6151 8257 744 <+49%206151%208257744> | Fax: +49 (0)6151 8257 > 799 <+49%206151%208257799> > oliver.weinm...@telespazio-vega.de > http://www.telespazio-vega.de > > Registered office/Sitz: Darmstadt, Register court/Registergericht: > Darmstadt, HRB 89231; Managing Director/Geschäftsführer: Sigmar Keller > > > > What is the output from fmdump / fmdump -v? Also, it would be good to have > a better understanding of your setup. We have been using NFS shares from > OmniOS since r006 on OVM and also VMWare and at least the NFS part has > always been very solid for us. So, how did you setup your storage and how > many NFS clients do you have? > > > > Cheers, > > Stephan > > ___ > OmniOS-discuss mailing list > OmniOS-discuss@lists.omniti.com > http://lists.omniti.com/mailman/listinfo/omnios-discuss > > ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] Loosing NFS shares
One more thing I just noticed is that the system seems to be unable to mount directories: root@omnios01:/hgst4u60/ReferenceAC/AGDEMO# /usr/sbin/zfs mount -a cannot mount '/hgst4u60/ReferenceAC': directory is not empty cannot mount '/hgst4u60/ReferenceDF': directory is not empty cannot mount '/hgst4u60/ReferenceGI': directory is not empty cannot mount '/hgst4u60/ReferenceJL': directory is not empty cannot mount '/hgst4u60/ReferenceMO': directory is not empty cannot mount '/hgst4u60/ReferencePR': directory is not empty cannot mount '/hgst4u60/ReferenceSU': directory is not empty cannot mount '/hgst4u60/ReferenceVX': directory is not empty cannot mount '/hgst4u60/ReferenceYZ': directory is not empty Maybe this is where all problems are coming from? From: Stephan Budach [mailto:stephan.bud...@jvm.de] Sent: Donnerstag, 22. Juni 2017 09:30 To: Oliver Weinmann <oliver.weinm...@telespazio-vega.de> Cc: omnios-discuss <omnios-discuss@lists.omniti.com> Subject: Re: [OmniOS-discuss] Loosing NFS shares Hi Oliver, _ Von: "Oliver Weinmann" < <mailto:oliver.weinm...@telespazio-vega.de> oliver.weinm...@telespazio-vega.de> An: "Tobias Oetiker" < <mailto:t...@oetiker.ch> t...@oetiker.ch> CC: "omnios-discuss" < <mailto:omnios-discuss@lists.omniti.com> omnios-discuss@lists.omniti.com> Gesendet: Donnerstag, 22. Juni 2017 09:13:27 Betreff: Re: [OmniOS-discuss] Loosing NFS shares Hi, Don’t think so: svcs -vx rcapd shows nothing. Oliver Weinmann Senior Unix VMWare, Storage Engineer Telespazio VEGA Deutschland GmbH Europaplatz 5 - 64293 Darmstadt - Germany Ph: + 49 (0)6151 8257 744 | Fax: +49 (0)6151 8257 799 <mailto:oliver.weinm...@telespazio-vega.de> oliver.weinm...@telespazio-vega.de <http://www.telespazio-vega.de> http://www.telespazio-vega.de Registered office/Sitz: Darmstadt, Register court/Registergericht: Darmstadt, HRB 89231; Managing Director/Geschäftsführer: Sigmar Keller From: Tobias Oetiker [mailto:t...@oetiker.ch] Sent: Donnerstag, 22. Juni 2017 09:11 To: Oliver Weinmann <oliver.weinm...@telespazio-vega.de <mailto:oliver.weinm...@telespazio-vega.de> > Cc: omnios-discuss <omnios-discuss@lists.omniti.com <mailto:omnios-discuss@lists.omniti.com> > Subject: Re: [OmniOS-discuss] Loosing NFS shares Oliver, are you running rcapd ? we found that (at least of the box) this thing wrecks havoc to both nfs and iscsi sharing ... cheers tobi - On Jun 22, 2017, at 8:45 AM, Oliver Weinmann < <mailto:oliver.weinm...@telespazio-vega.de> oliver.weinm...@telespazio-vega.de> wrote: Hi, we are using OmniOS for a few months now and have big trouble with stability. We mainly use it for VMware NFS datastores. The last 3 nights we lost all NFS datastores and VMs stopped running. I noticed that even though zfs get sharenfs shows folders as shared they become inaccessible. Setting sharenfs to off and sharing again solves the issue. I have no clue where to start. I’m fairly new to OmniOS. Any help would be highly appreciated. Thanks and Best Regards, Oliver Oliver Weinmann Senior Unix VMWare, Storage Engineer Telespazio VEGA Deutschland GmbH Europaplatz 5 - 64293 Darmstadt - Germany Ph: + 49 (0)6151 8257 744 | Fax: +49 (0)6151 8257 799 <mailto:oliver.weinm...@telespazio-vega.de> oliver.weinm...@telespazio-vega.de <http://www.telespazio-vega.de> http://www.telespazio-vega.de Registered office/Sitz: Darmstadt, Register court/Registergericht: Darmstadt, HRB 89231; Managing Director/Geschäftsführer: Sigmar Keller What is the output from fmdump / fmdump -v? Also, it would be good to have a better understanding of your setup. We have been using NFS shares from OmniOS since r006 on OVM and also VMWare and at least the NFS part has always been very solid for us. So, how did you setup your storage and how many NFS clients do you have? Cheers, Stephan smime.p7s Description: S/MIME cryptographic signature ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] Loosing NFS shares
Repair Attempted Problem in: svc:///network/ldap/client:default Affects: svc:///network/ldap/client:default FRU: - Location: - May 23 16:58:42.2836 af1d96ae-489e-46cb-b4da-b5adf5780018 SMF-8000-YX Diagnosed 100% defect.sunos.smf.svc.maintenance Problem in: svc:///network/ldap/client:default Affects: svc:///network/ldap/client:default FRU: - Location: - May 23 17:01:53.4846 af1d96ae-489e-46cb-b4da-b5adf5780018 FMD-8000-4M Repaired 100% defect.sunos.smf.svc.maintenanceRepair Attempted Problem in: svc:///network/ldap/client:default Affects: svc:///network/ldap/client:default FRU: - Location: - May 23 17:01:53.4857 af1d96ae-489e-46cb-b4da-b5adf5780018 FMD-8000-6U Resolved 100% defect.sunos.smf.svc.maintenanceRepair Attempted Problem in: svc:///network/ldap/client:default Affects: svc:///network/ldap/client:default FRU: - Location: - May 24 10:04:18.5145 34f126dd-fd71-4de2-cafd-dd084438d63a SMF-8000-YX Diagnosed 100% defect.sunos.smf.svc.maintenance Problem in: svc:///network/ldap/client:default Affects: svc:///network/ldap/client:default FRU: - Location: - May 24 12:15:47.8823 34f126dd-fd71-4de2-cafd-dd084438d63a FMD-8000-4M Repaired 100% defect.sunos.smf.svc.maintenanceRepair Attempted Problem in: svc:///network/ldap/client:default Affects: svc:///network/ldap/client:default FRU: - Location: - May 24 12:15:47.8838 34f126dd-fd71-4de2-cafd-dd084438d63a FMD-8000-6U Resolved 100% defect.sunos.smf.svc.maintenanceRepair Attempted Problem in: svc:///network/ldap/client:default Affects: svc:///network/ldap/client:default FRU: - Location: - I do see a lot errors from mountd in /var/adm/messages: e.g. Jun 21 15:01:22 omnios01 mountd[766]: [ID 801587 daemon.notice] /hgst4u60/ReferenceAC/AGDEMO/Software/Unix: No such file or directory While these exist and I can access them just fine. root@omnios01:/hgst4u60# zfs list hgst4u60/ReferenceAC/AGDEMO NAME USED AVAIL REFER MOUNTPOINT hgst4u60/ReferenceAC/AGDEMO 256K 5.00G 256K /hgst4u60/ReferenceAC/AGDEMO root@omnios01:/hgst4u60/ReferenceAC/AGDEMO# df -h . Filesystem Size Used Available Capacity Mounted on hgst4u60/ReferenceAC/AGDEMO 5.0G 256K 5.0G 1% /hgst4u60/ReferenceAC/AGDEMO Also there is an error for smbd shown on the console very often: Jun 21 16:26:46 omnios01 smbd[628]: [ID 160719 auth.alert] adt_set_user: Invalid argument From: Stephan Budach [mailto:stephan.bud...@jvm.de] Sent: Donnerstag, 22. Juni 2017 09:30 To: Oliver Weinmann <oliver.weinm...@telespazio-vega.de> Cc: omnios-discuss <omnios-discuss@lists.omniti.com> Subject: Re: [OmniOS-discuss] Loosing NFS shares Hi Oliver, _ Von: "Oliver Weinmann" <oliver.weinm...@telespazio-vega.de <mailto:oliver.weinm...@telespazio-vega.de> > An: "Tobias Oetiker" <t...@oetiker.ch <mailto:t...@oetiker.ch> > CC: "omnios-discuss" <omnios-discuss@lists.omniti.com <mailto:omnios-discuss@lists.omniti.com> > Gesendet: Donnerstag, 22. Juni 2017 09:13:27 Betreff: Re: [OmniOS-discuss] Loosing NFS shares Hi, Don’t think so: svcs -vx rcapd shows nothing. Oliver Weinmann Senior Unix VMWare, Storage Engineer Telespazio VEGA Deutschland GmbH Europaplatz 5 - 64293 Darmstadt - Germany Ph: + 49 (0)6151 8257 744 | Fax: +49 (0)6151 8257 799 oliver.weinm...@telespazio-vega.de <mailto:oliver.weinm...@telespazio-vega.de> http://www.telespazio-vega.de Registered office/Sitz: Darmstadt, Register court/Registergericht: Darmstadt, HRB 89231; Managing Director/Geschäftsführer: Sigmar Keller From: Tobias Oetiker [mailto:t...@oetiker.ch] Sent: Donnerstag, 22. Juni 2017 09:11 To: Oliver Weinmann <oliver.weinm...@telespazio-vega.de <mailto:oliver.weinm...@telespazio-vega.de> > Cc: omnios-discuss <omnios-discuss@lists.omniti.com <mailto:omnios-discuss@lists.omniti.com> > Subject: Re: [OmniOS-discuss] Loosing NFS shares Oliver, are you running rcapd ? we found that (at least of the box) this thing wrecks havoc to both nfs and iscsi sharing ... cheers tobi - On Jun 22, 2017, at 8:45 AM, Oliver Weinmann <oliver.weinm...@telespazio-vega.de <mailto:oliver.weinm...@telespazio-vega.de> > wrote: Hi, we are using OmniOS for a few months now and have big trouble with stability. We mainly use it for VMware NFS datastores. The last 3 nights we lost all NFS datastores and VMs stopped running. I noticed that eve
Re: [OmniOS-discuss] Loosing NFS shares
Hi Oliver, Von: "Oliver Weinmann" <oliver.weinm...@telespazio-vega.de> An: "Tobias Oetiker" <t...@oetiker.ch> CC: "omnios-discuss" <omnios-discuss@lists.omniti.com> Gesendet: Donnerstag, 22. Juni 2017 09:13:27 Betreff: Re: [OmniOS-discuss] Loosing NFS shares Hi, Don’t think so: svcs -vx rcapd shows nothing. Oliver Weinmann Senior Unix VMWare, Storage Engineer Telespazio VEGA Deutschland GmbH Europaplatz 5 - 64293 Darmstadt - Germany Ph: + 49 (0)6151 8257 744 | Fax: +49 (0)6151 8257 799 [ mailto:oliver.weinm...@telespazio-vega.de | oliver.weinm...@telespazio-vega.de ] [ http://www.telespazio-vega.de/ | http://www.telespazio-vega.de ] Registered office/Sitz: Darmstadt, Register court/Registergericht: Darmstadt, HRB 89231; Managing Director/Geschäftsführer: Sigmar Keller From: Tobias Oetiker [mailto:t...@oetiker.ch] Sent: Donnerstag, 22. Juni 2017 09:11 To: Oliver Weinmann <oliver.weinm...@telespazio-vega.de> Cc: omnios-discuss <omnios-discuss@lists.omniti.com> Subject: Re: [OmniOS-discuss] Loosing NFS shares Oliver, are you running rcapd ? we found that (at least of the box) this thing wrecks havoc to both nfs and iscsi sharing ... cheers tobi - On Jun 22, 2017, at 8:45 AM, Oliver Weinmann < [ mailto:oliver.weinm...@telespazio-vega.de | oliver.weinm...@telespazio-vega.de ] > wrote: Hi, we are using OmniOS for a few months now and have big trouble with stability. We mainly use it for VMware NFS datastores. The last 3 nights we lost all NFS datastores and VMs stopped running. I noticed that even though zfs get sharenfs shows folders as shared they become inaccessible. Setting sharenfs to off and sharing again solves the issue. I have no clue where to start. I’m fairly new to OmniOS. Any help would be highly appreciated. Thanks and Best Regards, Oliver Oliver Weinmann Senior Unix VMWare, Storage Engineer Telespazio VEGA Deutschland GmbH Europaplatz 5 - 64293 Darmstadt - Germany Ph: + 49 (0)6151 8257 744 | Fax: +49 (0)6151 8257 799 [ mailto:oliver.weinm...@telespazio-vega.de | oliver.weinm...@telespazio-vega.de ] [ http://www.telespazio-vega.de/ | http://www.telespazio-vega.de ] Registered office/Sitz: Darmstadt, Register court/Registergericht: Darmstadt, HRB 89231; Managing Director/Geschäftsführer: Sigmar Keller What is the output from fmdump / fmdump -v? Also, it would be good to have a better understanding of your setup. We have been using NFS shares from OmniOS since r006 on OVM and also VMWare and at least the NFS part has always been very solid for us. So, how did you setup your storage and how many NFS clients do you have? Cheers, Stephan smime.p7s Description: S/MIME cryptographic signature ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] Loosing NFS shares
Hi Oliver, - Ursprüngliche Mail - > Von: "Oliver Weinmann"> An: omnios-discuss@lists.omniti.com > Gesendet: Donnerstag, 22. Juni 2017 08:45:14 > Betreff: [OmniOS-discuss] Loosing NFS shares > Hi, > we are using OmniOS for a few months now and have big trouble with > stability. We mainly use it for VMware NFS datastores. The last 3 > nights we lost all NFS datastores and VMs stopped running. I noticed > that even though zfs get sharenfs shows folders as shared they > become inaccessible. Setting sharenfs to off and sharing again > solves the issue. I have no clue where to start. I’m fairly new to > OmniOS. > Any help would be highly appreciated. > Thanks and Best Regards, > Oliver smime.p7s Description: S/MIME cryptographic signature ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] Loosing NFS shares
Hi, Don’t think so: svcs -vx rcapd shows nothing. [cid:Logo_Telespazio_180_px_signature_eng_b58fa623-e26d-4116-9230-766adacfe55e1.png] Oliver Weinmann Senior Unix VMWare, Storage Engineer Telespazio VEGA Deutschland GmbH Europaplatz 5 - 64293 Darmstadt - Germany Ph: + 49 (0)6151 8257 744 | Fax: +49 (0)6151 8257 799 oliver.weinm...@telespazio-vega.de<mailto:oliver.weinm...@telespazio-vega.de> http://www.telespazio-vega.de Registered office/Sitz: Darmstadt, Register court/Registergericht: Darmstadt, HRB 89231; Managing Director/Geschäftsführer: Sigmar Keller From: Tobias Oetiker [mailto:t...@oetiker.ch] Sent: Donnerstag, 22. Juni 2017 09:11 To: Oliver Weinmann <oliver.weinm...@telespazio-vega.de> Cc: omnios-discuss <omnios-discuss@lists.omniti.com> Subject: Re: [OmniOS-discuss] Loosing NFS shares Oliver, are you running rcapd ? we found that (at least of the box) this thing wrecks havoc to both nfs and iscsi sharing ... cheers tobi - On Jun 22, 2017, at 8:45 AM, Oliver Weinmann <oliver.weinm...@telespazio-vega.de<mailto:oliver.weinm...@telespazio-vega.de>> wrote: Hi, we are using OmniOS for a few months now and have big trouble with stability. We mainly use it for VMware NFS datastores. The last 3 nights we lost all NFS datastores and VMs stopped running. I noticed that even though zfs get sharenfs shows folders as shared they become inaccessible. Setting sharenfs to off and sharing again solves the issue. I have no clue where to start. I’m fairly new to OmniOS. Any help would be highly appreciated. Thanks and Best Regards, Oliver [cid:image001.png@01D2EB37.CE643CD0] Oliver Weinmann Senior Unix VMWare, Storage Engineer Telespazio VEGA Deutschland GmbH Europaplatz 5 - 64293 Darmstadt - Germany Ph: + 49 (0)6151 8257 744 | Fax: +49 (0)6151 8257 799 oliver.weinm...@telespazio-vega.de<mailto:oliver.weinm...@telespazio-vega.de> http://www.telespazio-vega.de Registered office/Sitz: Darmstadt, Register court/Registergericht: Darmstadt, HRB 89231; Managing Director/Geschäftsführer: Sigmar Keller ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com<mailto:OmniOS-discuss@lists.omniti.com> http://lists.omniti.com/mailman/listinfo/omnios-discuss -- Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15 CH-4600 Olten, Switzerland www.oetiker.ch<http://www.oetiker.ch> t...@oetiker.ch<mailto:t...@oetiker.ch> +41 62 775 9902 ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] Loosing NFS shares
Oliver, are you running rcapd ? we found that (at least of the box) this thing wrecks havoc to both nfs and iscsi sharing ... cheers tobi - On Jun 22, 2017, at 8:45 AM, Oliver Weinmannwrote: > Hi, > we are using OmniOS for a few months now and have big trouble with stability. > We > mainly use it for VMware NFS datastores. The last 3 nights we lost all NFS > datastores and VMs stopped running. I noticed that even though zfs get > sharenfs > shows folders as shared they become inaccessible. Setting sharenfs to off and > sharing again solves the issue. I have no clue where to start. I’m fairly new > to OmniOS. > Any help would be highly appreciated. > Thanks and Best Regards, > Oliver > Oliver Weinmann > Senior Unix VMWare, Storage Engineer > Telespazio VEGA Deutschland GmbH > Europaplatz 5 - 64293 Darmstadt - Germany > Ph: + 49 (0)6151 8257 744 | Fax: +49 (0)6151 8257 799 > [ mailto:oliver.weinm...@telespazio-vega.de | > oliver.weinm...@telespazio-vega.de > ] > [ http://www.telespazio-vega.de/ | http://www.telespazio-vega.de ] > Registered office/Sitz: Darmstadt, Register court/Registergericht: Darmstadt, > HRB 89231; Managing Director/Geschäftsführer: Sigmar Keller > ___ > OmniOS-discuss mailing list > OmniOS-discuss@lists.omniti.com > http://lists.omniti.com/mailman/listinfo/omnios-discuss -- Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15 CH-4600 Olten, Switzerland www.oetiker.ch t...@oetiker.ch +41 62 775 9902 ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss