EXPORT block doesn't have NFS_Protocols parameter. It can be specified
in core params which is an alias to Protocols. Change NFS_Protocols to
Protocols. That should avoid some other errors too.
You may get into other issues with CEPH fsal specific issues later or it
may just work.
Regards, Malahal.
Timofey Titovets [nefelim...@gmail.com] wrote:
> I've add it, that i've get from ganesha it wan't create log file, it
> just copy paste from journalctl
>
>
> LOG
> {
>
> Facility {
> name = FILE;
> destination = /var/log/nfs-ganesha.log;
> max_level = FULL_DEBUG;
> headers = all;
> enable = idle;
> }
>
> COMPONENTS
> {
> EXPORT=FullDebug;
> NFS3=FullDebug;
> FSAL=FullDebug;
> }
> }
>
>
> EXPORT
> {
> Export_ID = 1;
> Path = "/cephfs_v3";
> Access_Type = RW;
> NFS_Protocols = 3;
> Squash = No_Root_Squash;
> FSAL {
> Name = CEPH;
> }
> }
>
> Log:
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9864]: [main]
> nfs4_clean_old_recov_dir :CLIENT ID :EVENT :Failed to open old v4
> recovery dir (/usr/var/lib/nfs/ganesha/v4old/node0), errno=2
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 systemd[1]: Starting NFS-Ganesha
> file server...
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9952]: [main] main
> :MAIN :EVENT :ganesha.nfsd Starting: Ganesha Version
> V2.2.0-0-g4b99ef8, built at Apr 24 2015 00:47:38 on
> srv-lab-ceph-node-03
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 systemd[1]: Started NFS-Ganesha
> file server.
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> log_conf_commit :CONFIG :EVENT :Switching to new component log levels
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs_set_param_from_conf :NFS STARTUP :EVENT :Configuration file
> successfully parsed
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> init_server_pkgs :NFS STARTUP :EVENT :Initializing ID Mapper.
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> init_server_pkgs :NFS STARTUP :EVENT :ID Mapper successfully
> initialized.
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 polkitd(authority=local)[7075]:
> Unregistered Authentication Agent for unix-process:9944:437605 (system
> bus name :1.48, object path
> /org/freedesktop/PolicyKit1/AuthenticationAgent, locale en_US.UTF-8)
> (disconnected from bus)
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> export_commit_common :CONFIG :CRIT :Exporting to NFSv4 but not Pseudo
> path defined
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main] main
> :NFS STARTUP :WARN :No export entries found in configuration file !!!
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> config_errs_to_log :CONFIG :CRIT :Config File
> (/usr/etc/ganesha/ganesha.conf:26): Unknown token
> (/usr/etc/ganesha/ganesha.conf)
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> config_errs_to_log :CONFIG :CRIT :Config File
> (/usr/etc/ganesha/ganesha.conf:25): Unknown token
> (/usr/etc/ganesha/ganesha.conf)
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> config_errs_to_log :CONFIG :CRIT :Config File
> (/usr/etc/ganesha/ganesha.conf:24): Unknown token
> (/usr/etc/ganesha/ganesha.conf)
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> config_errs_to_log :CONFIG :CRIT :Config File
> (/usr/etc/ganesha/ganesha.conf:31): 3 (unknown param) errors found
> block LOG
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> config_errs_to_log :CONFIG :CRIT :Config File
> (/usr/etc/ganesha/ganesha.conf:36): Unknown parameter (NFS_Protocols)
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> config_errs_to_log :CONFIG :CRIT :Config File
> (/usr/etc/ganesha/ganesha.conf:31): 1 validation errors in block
> EXPORT
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> config_errs_to_log :CONFIG :CRIT :Config File
> (/usr/etc/ganesha/ganesha.conf:31): Errors processing block (EXPORT)
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs_Init_svc :DISP :CRIT :Cannot acquire credentials for principal nfs
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs_Init_admin_thread :NFS CB :EVENT :Admin thread initialized
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs4_create_recov_dir :CLIENT ID :EVENT :Failed to create v4 recovery
> dir (/usr/var/lib/nfs/ganesha), errno=2
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs4_create_recov_dir :CLIENT ID :EVENT :Failed to create v4 recovery
> dir(/usr/var/lib/nfs/ganesha/v4recov), errno=2
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs4_create_recov_dir :CLIENT ID :EVENT :Failed to create v4 recovery
> dir(/usr/var/lib/nfs/ganesha/v4old), errno=2
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs4_create_recov_dir :CLIENT ID :EVENT :Failed to create v4 recovery
> dir(/usr/var/lib/nfs/ganesha/v4recov/node0), errno=2
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs4_create_recov_dir :CLIENT ID :EVENT :Failed to create v4 recovery
> dir(/usr/var/lib/nfs/ganesha/v4old/node0), errno=2
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs4_load_recov_clids_nolock :CLIENT ID :EVENT :Failed to open v4
> recovery dir (/usr/var/lib/nfs/ganesha/v4old/node0), errno=2
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs4_start_grace :STATE :EVENT :NFS Server Now IN GRACE, duration 60
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs_rpc_cb_init_ccache :NFS STARTUP :EVENT :Callback creds directory
> (/usr/var/run/ganesha) already exists
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs_rpc_cb_init_ccache :NFS STARTUP :WARN
> :gssd_refresh_krb5_machine_credential failed (-1765328160:0)
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs_Start_threads :THREAD :EVENT :Starting delayed executor.
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs_Start_threads :THREAD :EVENT :9P/TCP dispatcher thread was started
> successfully
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs_Start_threads :THREAD :EVENT :admin thread was started
> successfully
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs_Start_threads :THREAD :EVENT :reaper thread was started
> successfully
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs_Start_threads :THREAD :EVENT :General fridge was started
> successfully
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [_9p_disp]
> _9p_dispatcher_thread :9P DISP :EVENT :9P dispatcher started
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [reaper]
> nfs_in_grace :STATE :EVENT :NFS Server Now IN GRACE
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 rpc.statd[7836]: Received
> SM_UNMON_ALL request from srv-lab-ceph-proxy-01 while not monitoring
> any hosts
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs_start :NFS STARTUP :EVENT
> :-------------------------------------------------
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs_start :NFS STARTUP :EVENT : NFS SERVER INITIALIZED
> Apr 24 21:43:35 srv-lab-ceph-proxy-01 nfs-ganesha[9953]: [main]
> nfs_start :NFS STARTUP :EVENT
> :-------------------------------------------------
>
> 2015-04-24 20:57 GMT+03:00 Frank Filz <ffilz...@mindspring.com>:
> >> I try to explain - what i've successful mount server with nfsv4 and work
> > with
> >> it, but can't do it with nfsv3, and does not matter what FASL i've using
> > (VFS or
> >> Ceph) i.e. i don't have problem with NFSv4 and ai can work with ceph by
> > it, so
> >> beautiful, but if i try to connect with nfsv3, i've get some problems, and
> > i just
> >> try to understand what i can miss _-_
> >>
> >> Yes, i've use V2.2, but i've same problem with V2.1 (it can be something
> >> debian/ubuntu specific _-_)
> >
> > Hmm, let's try adding some debug logging (please use V2.2.0), add this to
> > your config:
> >
> > LOG
> > {
> > COMPONENTS
> > {
> > EXPORT=FullDebug;
> > NFS3=FullDebug;
> > FSAL=FullDebug;
> > }
> > }
> >
> > That should help us determine where the issue is.
> >
> > Thanks
> >
> > Frank
> >
> >> 2015-04-24 20:04 GMT+03:00 Matt W. Benjamin <m...@cohortfs.com>:
> >> > Hi,
> >> >
> >> > The Ceph FSAL uses the libcephfs (and librados) to consume the cluster.
> >> > It's not re-exporting a mounted Ceph filesystem.
> >> >
> >> > Matt
> >> >
> >> > ----- "Timofey Titovets" <nefelim...@gmail.com> wrote:
> >> >
> >> >> showmount -e 172.20.252.12
> >> >> Export list for 172.20.252.12:
> >> >> / (everyone)
> >> >>
> >> >> 2015-04-24 10:33 GMT+03:00 DENIEL Philippe <philippe.den...@cea.fr>:
> >> >> > Hi,
> >> >> >
> >> >> > what does " showmount -e 172.20.252.12 " say ? This way, you'll see
> >> >> if
> >> >> > Ganesha was capable of building the export entries.
> >> >> > My knowledge of CEPH is weak, so I forward your question to
> >> >> > nfs-gamesha-devel. In particular, I do not know if:
> >> >> > - CEPH support open_by_handle_at() syscall
> >> >> > - FSAL_CEPH can work on a "regular" CEPH distribution. I
> >> >> remember
> >> >> > that Matt and Adam made some changes to CEPH to ease pNFS
> >> >> > implementation, and I do not know if those commits went upstream.
> >> >> They
> >> >> > will tell us about this.
> >> >> >
> >> >> > Regards
> >> >> >
> >> >> > Philippe
> >> >> >
> >> >> > On 04/24/15 09:18, Timofey Titovets wrote:
> >> >> >> Good time of day, I've try to setup nfs-ganesha server on Ubuntu
> >> >> 15.04
> >> >> >> Builded by last source from master tree.
> >> >> >>
> >> >> >> 1. Can't be mounted with nfsv3
> >> >> >> Config:
> >> >> >> EXPORT
> >> >> >> {
> >> >> >> # Export Id (mandatory, each EXPORT must have a unique
> >> >> Export_Id)
> >> >> >> Export_Id = 77;
> >> >> >> # Exported path (mandatory)
> >> >> >> Path = /storage;
> >> >> >> # Pseudo Path (required for NFS v4)
> >> >> >> Pseudo = /cephfs;
> >> >> >> Access_Type = RW;
> >> >> >> NFS_Protocols = 3;
> >> >> >> FSAL {
> >> >> >> Name = VFS;
> >> >> >> }
> >> >> >> }
> >> >> >> Or
> >> >> >> EXPORT
> >> >> >> {
> >> >> >> Export_ID = 1;
> >> >> >> Path = "/";
> >> >> >> Pseudo = "/cephfs";
> >> >> >> Access_Type = RW;
> >> >> >> NFS_Protocols = 3;
> >> >> >> Transport_Protocols = TCP;
> >> >> >> FSAL {
> >> >> >> Name = CEPH;
> >> >> >> }
> >> >> >> }
> >> >> >>
> >> >> >> On client I've get:
> >> >> >> # mount -o nfsvers=3 172.20.252.12:/ /mnt -v
> >> >> >> mount.nfs: timeout set for Fri Apr 24 09:47:50 2015
> >> >> >> mount.nfs: trying text-based options
> >> >> 'nfsvers=3,addr=172.20.252.12'
> >> >> >> mount.nfs: prog 100003, trying vers=3, prot=6
> >> >> >> mount.nfs: trying 172.20.252.12 prog 100003 vers 3 prot TCP port
> >> >> 2049
> >> >> >> mount.nfs: prog 100005, trying vers=3, prot=17
> >> >> >> mount.nfs: trying 172.20.252.12 prog 100005 vers 3 prot UDP port
> >> >> 40321
> >> >> >> mount.nfs: mount(2): Permission denied
> >> >> >> mount.nfs: access denied by server while mounting 172.20.252.12:/
> >> >> >>
> >> >> >> What's did I wrong? %)
> >> >> >>
> >> >> >
> >> >> >
> >> >> >
> >> >> ---------------------------------------------------------------------
> >> >> ---------
> >> >> > One dashboard for servers and applications across
> >> >> Physical-Virtual-Cloud
> >> >> > Widest out-of-the-box monitoring support with 50+ applications
> >> >> > Performance metrics, stats and reports that give you Actionable
> >> >> Insights
> >> >> > Deep dive visibility with transaction tracing using APM Insight.
> >> >> > http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> >> >> > _______________________________________________
> >> >> > Nfs-ganesha-support mailing list
> >> >> > nfs-ganesha-supp...@lists.sourceforge.net
> >> >> > https://lists.sourceforge.net/lists/listinfo/nfs-ganesha-support
> >> >>
> >> >>
> >> >>
> >> >> --
> >> >> Have a nice day,
> >> >> Timofey.
> >> >>
> >> >> ---------------------------------------------------------------------
> >> >> --------- One dashboard for servers and applications across
> >> >> Physical-Virtual-Cloud Widest out-of-the-box monitoring support with
> >> >> 50+ applications Performance metrics, stats and reports that give you
> >> >> Actionable Insights Deep dive visibility with transaction tracing
> >> >> using APM Insight.
> >> >> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> >> >> _______________________________________________
> >> >> Nfs-ganesha-devel mailing list
> >> >> Nfs-ganesha-devel@lists.sourceforge.net
> >> >> https://lists.sourceforge.net/lists/listinfo/nfs-ganesha-devel
> >> >
> >> > --
> >> > Matt Benjamin
> >> > CohortFS, LLC.
> >> > 315 West Huron Street, Suite 140A
> >> > Ann Arbor, Michigan 48103
> >> >
> >> > http://cohortfs.com
> >> >
> >> > tel. 734-761-4689
> >> > fax. 734-769-8938
> >> > cel. 734-216-5309
> >>
> >>
> >>
> >> --
> >> Have a nice day,
> >> Timofey.
> >>
> >>
> > ----------------------------------------------------------------------------
> > --
> >> One dashboard for servers and applications across Physical-Virtual-Cloud
> >> Widest out-of-the-box monitoring support with 50+ applications
> >> Performance metrics, stats and reports that give you Actionable Insights
> >> Deep dive visibility with transaction tracing using APM Insight.
> >> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> >> _______________________________________________
> >> Nfs-ganesha-support mailing list
> >> nfs-ganesha-supp...@lists.sourceforge.net
> >> https://lists.sourceforge.net/lists/listinfo/nfs-ganesha-support
> >
>
>
>
> --
> Have a nice day,
> Timofey.
>
> ------------------------------------------------------------------------------
> One dashboard for servers and applications across Physical-Virtual-Cloud
> Widest out-of-the-box monitoring support with 50+ applications
> Performance metrics, stats and reports that give you Actionable Insights
> Deep dive visibility with transaction tracing using APM Insight.
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> _______________________________________________
> Nfs-ganesha-support mailing list
> nfs-ganesha-supp...@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/nfs-ganesha-support
>
------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
_______________________________________________
Nfs-ganesha-devel mailing list
Nfs-ganesha-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs-ganesha-devel
