You will definitely need to change "master" to the IP address that the nodes will see - 172.20.0.1 You should also set the "nameservers" to something that actually serves DNS. It wouldn't be a bad thing to run a DNS server on the xCAT master node, but you don't absolutely have to. Everything else looks ok, but yes, you're right that you do need to tell xCAT about the nodes and their MACs. Do you see anything in /var/lib/dhcpd.leases? Do you have any nodes defined? (nodels command). You either need to statically define the nodes, via something like "chdef n101 mac=00:25:90:29:4b:40 groups=all" or use auto node discovery - but something has to set the MAC addresses in xCAT.
----- Original Message ----- From: "Stephen Cousins" <[email protected]> To: "xCAT Users Mailing list" <[email protected]> Sent: Tuesday, November 3, 2015 11:46:48 PM Subject: Re: [xcat-user] {Disarmed} Re: Network change -> dhcpd: DHCPDISCOVER: no free leases The OS for the head node is CentOS 7 ifconfig -a: enp11s0f0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 9000 inet 10.54.200.200 netmask 255.255.0.0 broadcast 10.54.255.255 inet6 fe80::225:90ff:fe18:c30e prefixlen 64 scopeid 0x20<link> ether 00:25:90:18:c3:0e txqueuelen 1000 (Ethernet) RX packets 4361702 bytes 3262025237 (3.0 GiB) RX errors 0 dropped 170 overruns 170 frame 0 TX packets 2824086 bytes 1195929007 (1.1 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 device memory 0xfbe20000-fbe3ffff enp11s0f1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 inet 172.20.0.1 netmask 255.255.0.0 broadcast 172.20.255.255 inet6 fe80::225:90ff:fe18:c30f prefixlen 64 scopeid 0x20<link> ether 00:25:90:18:c3:0f txqueuelen 1000 (Ethernet) RX packets 4376023 bytes 669599743 (638.5 MiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 11575987 bytes 2473097440 (2.3 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 device memory 0xfbee0000-fbefffff enp8s0f0: flags=4098<BROADCAST,MULTICAST> mtu 1500 ether 00:e0:ed:17:70:00 txqueuelen 1000 (Ethernet) RX packets 0 bytes 0 (0.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0 B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 enp8s0f1: flags=4098<BROADCAST,MULTICAST> mtu 1500 ether 00:e0:ed:17:70:01 txqueuelen 1000 (Ethernet) RX packets 0 bytes 0 (0.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0 B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 ib0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 65520 inet 10.55.50.100 netmask 255.255.0.0 broadcast 10.55.255.255 inet6 fe80::202:c903:7:f353 prefixlen 64 scopeid 0x20<link> Infiniband hardware address can be incorrect! Please read BUGS section in ifconfig(8). infiniband 80:00:00:48:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00 txqueuelen 256 (InfiniBand) RX packets 2407037 bytes 68324440907 (63.6 GiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 2894334 bytes 95158435534 (88.6 GiB) TX errors 0 dropped 4 overruns 0 carrier 0 collisions 0 lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536 inet 127.0.0.1 netmask 255.0.0.0 inet6 ::1 prefixlen 128 scopeid 0x10<host> loop txqueuelen 0 (Local Loopback) RX packets 7685623 bytes 2146959369 (1.9 GiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 7685623 bytes 2146959369 (1.9 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 Networks table: <blockquote> [root@gromit ~]# tabdump networks #netname,net,mask,mgtifname,gateway,dhcpserver,tftpserver,nameservers,ntpservers,logservers,dynamicrange,staticrange,staticrangeincrement,nodehostname,ddnsdomain,vlanid,domain,comments,disable "clusternet","172.20.0.0","255.255.0.0","enp11s0f1","<xcatmaster>","172.20.0.1","172.20.0.1","<xcatmaster>","172.20.0.1",,,"172.20.10.101-172.20.10.254",,,,,,, "publicnet","10.54.0.0","255.255.0.0","enp11s0f0",,,,,,,,,,,,,,, "172_21_0_0-255_255_0_0","172.21.0.0","255.255.0.0","ib0","<xcatmaster>",,"172.21.0.1",,,,,,,,,,,, </blockquote> Site: <blockquote> master is 127.0.0.1 which was not changed. Should it be 172.20.0.1? </blockquote> <blockquote> nameserver too is 127.0.0.1 and unchanged. </blockquote> xCAT version: 2.9.1 . Do you know how the DHCP server picks up the information about what MAC addresses are mapped to the IP addresses? I think that ultimately the information comes from the mac and node and hosts tables but I mean what files are the DHCP using to pick up that information. I don't see it in the usual place. Thanks a lot for your help Russell. Steve On Tue, Nov 3, 2015 at 10:41 PM, Russell Auld < [email protected] > wrote: <blockquote> What OS is the head node running? Can you show what the network settings on the head node are? E.g.: "ifconfig -a" or "ip addr show" Can you show the full output of the networks table? You will definitely need to change some things in the site table. nameservers and master to start with. Also, which version of xcat are you using? From: "Stephen Cousins" < [email protected] > To: "xCAT Users Mailing list" < [email protected] > Sent: Tuesday, November 3, 2015 3:16:09 PM Subject: Re: [xcat-user] Network change -> dhcpd: DHCPDISCOVER: no free leases Anything to look for specifically? Here is what tabdump site shows: <blockquote> #key,value,comments,disable "blademaxp","64",, "fsptimeout","0",, "installdir","/install",, "ipmimaxp","64",, "ipmiretries","3",, "ipmitimeout","2",, "consoleondemand","no",, "master","127.0.0.1",, "forwarders","$our-name-server",, "nameservers","127.0.0.1",, "maxssh","8",, "ppcmaxp","64",, "ppcretry","3",, "ppctimeout","0",, "powerinterval","0",, "syspowerinterval","0",, "sharedtftp","1",, "SNsyncfiledir","/var/xcat/syncfiles",, "nodesyncfiledir","/var/xcat/node/syncfiles",, "tftpdir","/tftpboot",, "xcatdport","3001",, "xcatiport","3002",, "xcatconfdir","/etc/xcat",, "timezone","America/New_York",, "useNmapfromMN","no",, "enableASMI","no",, "db2installloc","/mntdb2",, "databaseloc","/var/lib",, "sshbetweennodes","ALLGROUPS",, "dnshandler","ddns",, "vsftp","n",, "cleanupxcatpost","no",, "dhcplease","43200",, "auditnosyslog","0",, "dhcpinterfaces","enp11s0f1",, "domain","cluster",, </blockquote> Thanks, Steve On Tue, Nov 3, 2015 at 2:11 PM, Russell Auld < [email protected] > wrote: <blockquote> Check the site table. On Nov 3, 2015 1:14 PM, Stephen Cousins < [email protected] > wrote: > > Hi, > > I had improperly set my network to 172.0.0.0/16 thinking that that was in > private space. I later found that 172.16.0.0/12 is the real private space so > I changed entries in all of the tables to 172.20.*.*. I also changed entries > in /etc/hosts, and then reran makedns -n and makedhcp -n. After restarting > everything DHCP starts up fine but when I boot a node it comes up with > entries like: > > Nov 3 12:50:49 gromit dhcpd: DHCPDISCOVER from 00:25:90:29:4b:40 via > enp11s0f1: network enp11s0f1: no free leases > > So, I seem to not have gotten everything changed. The networks table has a > staticrange of: 172.20.10.101-172.20.10.254: > > "clusternet","172.20.0.0","255.255.0.0","enp11s0f1","<xcatmaster>","172.20.0.1","172.20.0.1","<xcatmaster>","172.20.0.1",,,"172.20.10.101-172.20.10.254",,,,,,, > > > > Here is what the generated dhcpd.conf file looks like: > >> #xCAT generated dhcp configuration >> >> authoritative; >> option conf-file code 209 = text; >> option space isan; >> option isan-encap-opts code 43 = encapsulate isan; >> option isan.iqn code 203 = string; >> option isan.root-path code 201 = string; >> option space gpxe; >> option gpxe-encap-opts code 175 = encapsulate gpxe; >> option gpxe.bus-id code 177 = string; >> option user-class-identifier code 77 = string; >> option gpxe.no-pxedhcp code 176 = unsigned integer 8; >> option tcode code 101 = text; >> option iscsi-initiator-iqn code 203 = string; >> ddns-update-style interim; >> ignore client-updates; >> option client-architecture code 93 = unsigned integer 16; >> option tcode "America/New_York"; >> option gpxe.no-pxedhcp 1; >> >> omapi-port 7911; >> key xcat_key { >> algorithm hmac-md5; >> secret "==============my_secret==================="; >> }; >> omapi-key xcat_key; >> class "pxe" { >> match if substring (option vendor-class-identifier, 0, 9) = "PXEClient"; >> ddns-updates off; >> max-lease-time 600; >> } >> shared-network enp11s0f1 { >> subnet 172.20.0.0 netmask 255.255.0.0 { >> max-lease-time 43200; >> min-lease-time 43200; >> default-lease-time 43200; >> option routers 172.20.0.1; >> next-server 172.20.0.1; >> option log-servers 172.20.0.1; >> option ntp-servers 172.20.0.1; >> option domain-name "cluster"; >> option domain-name-servers 172.20.0.1; >> option domain-search "cluster"; >> zone cluster. { >> primary 172.20.0.1; key xcat_key; >> } >> zone 20.172.IN-ADDR.ARPA. { >> primary 172.20.0.1; key xcat_key; >> } >> if option user-class-identifier = "xNBA" and option client-architecture = >> 00:00 { #x86, xCAT Network Boot Agent >> always-broadcast on; >> filename = " MailScanner has detected a possible fraud attempt from >> "172.20.0.1" claiming to be >> http://172.20.0.1/tftpboot/xcat/xnba/nets/172.20.0.0_16 "; >> } else if option user-class-identifier = "xNBA" and option >> client-architecture = 00:09 { #x86, xCAT Network Boot Agent >> filename = " MailScanner has detected a possible fraud attempt from >> "172.20.0.1" claiming to be >> http://172.20.0.1/tftpboot/xcat/xnba/nets/172.20.0.0_16.uefi "; >> } else if option client-architecture = 00:00 { #x86 >> filename "xcat/xnba.kpxe"; >> } else if option vendor-class-identifier = "Etherboot-5.4" { #x86 >> filename "xcat/xnba.kpxe"; >> } else if option client-architecture = 00:07 { #x86_64 uefi >> filename "xcat/xnba.efi"; >> } else if option client-architecture = 00:09 { #x86_64 uefi alternative id >> filename "xcat/xnba.efi"; >> } else if option client-architecture = 00:02 { #ia64 >> filename "elilo.efi"; >> } else if option client-architecture = 00:0e { #OPAL-v3 >> option conf-file = " MailScanner has detected a possible fraud attempt from >> "172.20.0.1" claiming to be >> http://172.20.0.1/tftpboot/pxelinux.cfg/p/172.20.0.0_16 "; >> } else if substring(filename,0,1) = null { #otherwise, provide yaboot if the >> client isn't specific >> filename "/yaboot"; >> } >> } # 172.20.0.0/255.255.0.0 subnet_end >> } # enp11s0f1 nic_end >> > I'm not sure how the static MAC addresses come into play with xCAT. I am used > to static entries being like: > >> >> host n101 { >> hardware ethernet 00:25:90:29:4b:40; >> fixed-address 172.20.10.101; >> } >> > > I see that I'll likely have issues with tftpd as well. I'll come try to > work through those when I get there. > > I guess I have two questions after all of this: > > 1. What do I need to do now to get things fixed? > 2. What would have been the correct way to do what I wanted to do. > > Thanks for your continued help with this project. > > Steve > > -- > ________________________________________________________________ > Steve Cousins Supercomputer Engineer/Administrator > Advanced Computing Group University of Maine System > 244 Neville Hall (UMS Data Center) (207) 561-3574 > Orono ME 04469 steve.cousins at maine.edu > ------------------------------------------------------------------------------ _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user </blockquote> -- ________________________________________________________________ Steve Cousins Supercomputer Engineer/Administrator Advanced Computing Group University of Maine System 244 Neville Hall (UMS Data Center) (207) 561-3574 Orono ME 04469 steve.cousins at maine.edu ------------------------------------------------------------------------------ _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user ------------------------------------------------------------------------------ _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user </blockquote> -- ________________________________________________________________ Steve Cousins Supercomputer Engineer/Administrator Advanced Computing Group University of Maine System 244 Neville Hall (UMS Data Center) (207) 561-3574 Orono ME 04469 steve.cousins at maine.edu ------------------------------------------------------------------------------ _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
_______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user
