Hi Russell, About the master and nameserver: they were both unchanged from prior to the IP change and the manager is set up as a name server. I didn't change the entries showing the 127.0.0.1 address and it was working previously so I figured it would continue to work. I'll give it a try with 172.20.0.1 though.
The /var/lib/dhcp/dhcpd.leases file had entries with the old IP's so I figured that maybe that was the problem. I stopped dhcpd and moved the dhcpd.leases to /tmp just to get it out of there thinking that when I started dhcpd up again it would create a new one and populate it as nodes booted up. I created a blank dhcpd.leases file and started up dhcpd but still the same thing when. I thought about it more and realized that that file was the missing piece that I was asking about. That file is what maps the MAC addresses to the static IP's. So, I moved the original dhcpd.leases file back and ran sed -i -e s/172.0.10/172.20.10/g dhcpd.leases and then restarted dhcpd. Success! The nodes boot up with the correct new IP. So, I guess my new question is: *What is supposed to create or recreate the dhcpd.leases file? *Presumably it would be makedhcp but that doesn't seem to be doing it. For completeness, I do have entries in the mac table and I did run chdef for each node. Thanks very much for your help. It's always helpful to have someone else look at things. Especially when the original eyes (mine) don't know exactly what to look for. Best regards, Steve On Wed, Nov 4, 2015 at 8:34 AM, Russell Auld <[email protected]> wrote: > You will definitely need to change "master" to the IP address that the > nodes will see - 172.20.0.1 > You should also set the "nameservers" to something that actually serves > DNS. It wouldn't be a bad thing to run a DNS server on the xCAT master > node, but you don't absolutely have to. > Everything else looks ok, but yes, you're right that you do need to tell > xCAT about the nodes and their MACs. > Do you see anything in /var/lib/dhcpd.leases? > Do you have any nodes defined? (nodels command). > You either need to statically define the nodes, via something like "chdef > n101 mac=00:25:90:29:4b:40 groups=all" > or use auto node discovery - but something has to set the MAC addresses in > xCAT. > > > ------------------------------ > *From: *"Stephen Cousins" <[email protected]> > *To: *"xCAT Users Mailing list" <[email protected]> > *Sent: *Tuesday, November 3, 2015 11:46:48 PM > *Subject: *Re: [xcat-user] {Disarmed} Re: Network change -> dhcpd: > DHCPDISCOVER: no free leases > > > The OS for the head node is CentOS 7 > > ifconfig -a: > > enp11s0f0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 9000 > inet 10.54.200.200 netmask 255.255.0.0 broadcast 10.54.255.255 > inet6 fe80::225:90ff:fe18:c30e prefixlen 64 scopeid 0x20<link> > ether 00:25:90:18:c3:0e txqueuelen 1000 (Ethernet) > RX packets 4361702 bytes 3262025237 (3.0 GiB) > RX errors 0 dropped 170 overruns 170 frame 0 > TX packets 2824086 bytes 1195929007 (1.1 GiB) > TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 > device memory 0xfbe20000-fbe3ffff > > enp11s0f1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 > inet 172.20.0.1 netmask 255.255.0.0 broadcast 172.20.255.255 > inet6 fe80::225:90ff:fe18:c30f prefixlen 64 scopeid 0x20<link> > ether 00:25:90:18:c3:0f txqueuelen 1000 (Ethernet) > RX packets 4376023 bytes 669599743 (638.5 MiB) > RX errors 0 dropped 0 overruns 0 frame 0 > TX packets 11575987 bytes 2473097440 (2.3 GiB) > TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 > device memory 0xfbee0000-fbefffff > > enp8s0f0: flags=4098<BROADCAST,MULTICAST> mtu 1500 > ether 00:e0:ed:17:70:00 txqueuelen 1000 (Ethernet) > RX packets 0 bytes 0 (0.0 B) > RX errors 0 dropped 0 overruns 0 frame 0 > TX packets 0 bytes 0 (0.0 B) > TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 > > enp8s0f1: flags=4098<BROADCAST,MULTICAST> mtu 1500 > ether 00:e0:ed:17:70:01 txqueuelen 1000 (Ethernet) > RX packets 0 bytes 0 (0.0 B) > RX errors 0 dropped 0 overruns 0 frame 0 > TX packets 0 bytes 0 (0.0 B) > TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 > > ib0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 65520 > inet 10.55.50.100 netmask 255.255.0.0 broadcast 10.55.255.255 > inet6 fe80::202:c903:7:f353 prefixlen 64 scopeid 0x20<link> > Infiniband hardware address can be incorrect! Please read BUGS section in > ifconfig(8). > infiniband > 80:00:00:48:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00 txqueuelen 256 > (InfiniBand) > RX packets 2407037 bytes 68324440907 (63.6 GiB) > RX errors 0 dropped 0 overruns 0 frame 0 > TX packets 2894334 bytes 95158435534 (88.6 GiB) > TX errors 0 dropped 4 overruns 0 carrier 0 collisions 0 > > lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536 > inet 127.0.0.1 netmask 255.0.0.0 > inet6 ::1 prefixlen 128 scopeid 0x10<host> > loop txqueuelen 0 (Local Loopback) > RX packets 7685623 bytes 2146959369 (1.9 GiB) > RX errors 0 dropped 0 overruns 0 frame 0 > TX packets 7685623 bytes 2146959369 (1.9 GiB) > TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 > > > > Networks table: > > [root@gromit ~]# tabdump networks > > #netname,net,mask,mgtifname,gateway,dhcpserver,tftpserver,nameservers,ntpservers,logservers,dynamicrange,staticrange,staticrangeincrement,nodehostname,ddnsdomain,vlanid,domain,comments,disable > > "clusternet","172.20.0.0","255.255.0.0","enp11s0f1","<xcatmaster>","172.20.0.1","172.20.0.1","<xcatmaster>","172.20.0.1",,,"172.20.10.101-172.20.10.254",,,,,,, > "publicnet","10.54.0.0","255.255.0.0","enp11s0f0",,,,,,,,,,,,,,, > > "172_21_0_0-255_255_0_0","172.21.0.0","255.255.0.0","ib0","<xcatmaster>",,"172.21.0.1",,,,,,,,,,,, > > > Site: > > master is 127.0.0.1 which was not changed. Should it be 172.20.0.1? > > nameserver too is 127.0.0.1 and unchanged. > > xCAT version: 2.9.1 > > . > > Do you know how the DHCP server picks up the information about what MAC > addresses are mapped to the IP addresses? I think that ultimately the > information comes from the mac and node and hosts tables but I mean what > files are the DHCP using to pick up that information. I don't see it in the > usual place. > > Thanks a lot for your help Russell. > > Steve > > > On Tue, Nov 3, 2015 at 10:41 PM, Russell Auld <[email protected]> > wrote: > >> What OS is the head node running? >> Can you show what the network settings on the head node are? E.g.: >> "ifconfig -a" or "ip addr show" >> Can you show the full output of the networks table? >> You will definitely need to change some things in the site table. >> nameservers and master to start with. >> Also, which version of xcat are you using? >> >> ------------------------------ >> *From: *"Stephen Cousins" <[email protected]> >> *To: *"xCAT Users Mailing list" <[email protected]> >> *Sent: *Tuesday, November 3, 2015 3:16:09 PM >> *Subject: *Re: [xcat-user] Network change -> dhcpd: DHCPDISCOVER: no >> free leases >> >> >> Anything to look for specifically? Here is what tabdump site shows: >> >> #key,value,comments,disable >> "blademaxp","64",, >> "fsptimeout","0",, >> "installdir","/install",, >> "ipmimaxp","64",, >> "ipmiretries","3",, >> "ipmitimeout","2",, >> "consoleondemand","no",, >> "master","127.0.0.1",, >> "forwarders","$our-name-server",, >> "nameservers","127.0.0.1",, >> "maxssh","8",, >> "ppcmaxp","64",, >> "ppcretry","3",, >> "ppctimeout","0",, >> "powerinterval","0",, >> "syspowerinterval","0",, >> "sharedtftp","1",, >> "SNsyncfiledir","/var/xcat/syncfiles",, >> "nodesyncfiledir","/var/xcat/node/syncfiles",, >> "tftpdir","/tftpboot",, >> "xcatdport","3001",, >> "xcatiport","3002",, >> "xcatconfdir","/etc/xcat",, >> "timezone","America/New_York",, >> "useNmapfromMN","no",, >> "enableASMI","no",, >> "db2installloc","/mntdb2",, >> "databaseloc","/var/lib",, >> "sshbetweennodes","ALLGROUPS",, >> "dnshandler","ddns",, >> "vsftp","n",, >> "cleanupxcatpost","no",, >> "dhcplease","43200",, >> "auditnosyslog","0",, >> "dhcpinterfaces","enp11s0f1",, >> "domain","cluster",, >> >> >> Thanks, >> >> Steve >> >> On Tue, Nov 3, 2015 at 2:11 PM, Russell Auld <[email protected]> >> wrote: >> >>> Check the site table. >>> >>> On Nov 3, 2015 1:14 PM, Stephen Cousins <[email protected]> wrote: >>> > >>> > Hi, >>> > >>> > I had improperly set my network to 172.0.0.0/16 thinking that that >>> was in private space. I later found that 172.16.0.0/12 is the real >>> private space so I changed entries in all of the tables to 172.20.*.*. I >>> also changed entries in /etc/hosts, and then reran makedns -n and makedhcp >>> -n. After restarting everything DHCP starts up fine but when I boot a node >>> it comes up with entries like: >>> > >>> > Nov 3 12:50:49 gromit dhcpd: DHCPDISCOVER from >>> 00:25:90:29:4b:40 via enp11s0f1: network enp11s0f1: no free leases >>> > >>> > So, I seem to not have gotten everything changed. The networks table >>> has a staticrange of: 172.20.10.101-172.20.10.254: >>> > >>> > >>> "clusternet","172.20.0.0","255.255.0.0","enp11s0f1","<xcatmaster>","172.20.0.1","172.20.0.1","<xcatmaster>","172.20.0.1",,,"172.20.10.101-172.20.10.254",,,,,,, >>> > >>> > >>> > Here is what the generated dhcpd.conf file looks like: >>> > >>> >> #xCAT generated dhcp configuration >>> >> >>> >> authoritative; >>> >> option conf-file code 209 = text; >>> >> option space isan; >>> >> option isan-encap-opts code 43 = encapsulate isan; >>> >> option isan.iqn code 203 = string; >>> >> option isan.root-path code 201 = string; >>> >> option space gpxe; >>> >> option gpxe-encap-opts code 175 = encapsulate gpxe; >>> >> option gpxe.bus-id code 177 = string; >>> >> option user-class-identifier code 77 = string; >>> >> option gpxe.no-pxedhcp code 176 = unsigned integer 8; >>> >> option tcode code 101 = text; >>> >> option iscsi-initiator-iqn code 203 = string; >>> >> ddns-update-style interim; >>> >> ignore client-updates; >>> >> option client-architecture code 93 = unsigned integer 16; >>> >> option tcode "America/New_York"; >>> >> option gpxe.no-pxedhcp 1; >>> >> >>> >> omapi-port 7911; >>> >> key xcat_key { >>> >> algorithm hmac-md5; >>> >> secret "==============my_secret==================="; >>> >> }; >>> >> omapi-key xcat_key; >>> >> class "pxe" { >>> >> match if substring (option vendor-class-identifier, 0, 9) = >>> "PXEClient"; >>> >> ddns-updates off; >>> >> max-lease-time 600; >>> >> } >>> >> shared-network enp11s0f1 { >>> >> subnet 172.20.0.0 netmask 255.255.0.0 { >>> >> max-lease-time 43200; >>> >> min-lease-time 43200; >>> >> default-lease-time 43200; >>> >> option routers 172.20.0.1; >>> >> next-server 172.20.0.1; >>> >> option log-servers 172.20.0.1; >>> >> option ntp-servers 172.20.0.1; >>> >> option domain-name "cluster"; >>> >> option domain-name-servers 172.20.0.1; >>> >> option domain-search "cluster"; >>> >> zone cluster. { >>> >> primary 172.20.0.1; key xcat_key; >>> >> } >>> >> zone 20.172.IN-ADDR.ARPA. { >>> >> primary 172.20.0.1; key xcat_key; >>> >> } >>> >> if option user-class-identifier = "xNBA" and option >>> client-architecture = 00:00 { #x86, xCAT Network Boot Agent >>> >> always-broadcast on; >>> >> filename = "*MailScanner has detected a possible fraud >>> attempt from "172.20.0.1" claiming to be* >>> http://172.20.0.1/tftpboot/xcat/xnba/nets/172.20.0.0_16 >>> <http://172.20.0.1/tftpboot/xcat/xnba/nets/172.20.0.0_16>"; >>> >> } else if option user-class-identifier = "xNBA" and option >>> client-architecture = 00:09 { #x86, xCAT Network Boot Agent >>> >> filename = "*MailScanner has detected a possible fraud >>> attempt from "172.20.0.1" claiming to be* >>> http://172.20.0.1/tftpboot/xcat/xnba/nets/172.20.0.0_16.uefi >>> <http://172.20.0.1/tftpboot/xcat/xnba/nets/172.20.0.0_16.uefi>"; >>> >> } else if option client-architecture = 00:00 { #x86 >>> >> filename "xcat/xnba.kpxe"; >>> >> } else if option vendor-class-identifier = "Etherboot-5.4" { #x86 >>> >> filename "xcat/xnba.kpxe"; >>> >> } else if option client-architecture = 00:07 { #x86_64 uefi >>> >> filename "xcat/xnba.efi"; >>> >> } else if option client-architecture = 00:09 { #x86_64 uefi >>> alternative id >>> >> filename "xcat/xnba.efi"; >>> >> } else if option client-architecture = 00:02 { #ia64 >>> >> filename "elilo.efi"; >>> >> } else if option client-architecture = 00:0e { #OPAL-v3 >>> >> option conf-file = "*MailScanner has detected a possible >>> fraud attempt from "172.20.0.1" claiming to be* >>> http://172.20.0.1/tftpboot/pxelinux.cfg/p/172.20.0.0_16 >>> <http://172.20.0.1/tftpboot/pxelinux.cfg/p/172.20.0.0_16>"; >>> >> } else if substring(filename,0,1) = null { #otherwise, provide >>> yaboot if the client isn't specific >>> >> filename "/yaboot"; >>> >> } >>> >> } # 172.20.0.0/255.255.0.0 subnet_end >>> >> } # enp11s0f1 nic_end >>> >> >>> > I'm not sure how the static MAC addresses come into play with xCAT. I >>> am used to static entries being like: >>> > >>> >> >>> >> host n101 { >>> >> hardware ethernet 00:25:90:29:4b:40; >>> >> fixed-address 172.20.10.101; >>> >> } >>> >> >>> > >>> > I see that I'll likely have issues with tftpd as well. I'll come try >>> to work through those when I get there. >>> > >>> > I guess I have two questions after all of this: >>> > >>> > 1. What do I need to do now to get things fixed? >>> > 2. What would have been the correct way to do what I wanted to do. >>> > >>> > Thanks for your continued help with this project. >>> > >>> > Steve >>> > >>> > -- >>> > ________________________________________________________________ >>> > Steve Cousins Supercomputer Engineer/Administrator >>> > Advanced Computing Group University of Maine System >>> > 244 Neville Hall (UMS Data Center) (207) 561-3574 >>> > Orono ME 04469 steve.cousins at maine.edu >>> > >>> >>> ------------------------------------------------------------------------------ >>> _______________________________________________ >>> xCAT-user mailing list >>> [email protected] >>> https://lists.sourceforge.net/lists/listinfo/xcat-user >>> >> >> >> >> -- >> ________________________________________________________________ >> Steve Cousins Supercomputer Engineer/Administrator >> Advanced Computing Group University of Maine System >> 244 Neville Hall (UMS Data Center) (207) 561-3574 >> Orono ME 04469 steve.cousins at maine.edu >> >> >> >> ------------------------------------------------------------------------------ >> >> _______________________________________________ >> xCAT-user mailing list >> [email protected] >> https://lists.sourceforge.net/lists/listinfo/xcat-user >> >> >> >> ------------------------------------------------------------------------------ >> >> _______________________________________________ >> xCAT-user mailing list >> [email protected] >> https://lists.sourceforge.net/lists/listinfo/xcat-user >> >> > > > -- > ________________________________________________________________ > Steve Cousins Supercomputer Engineer/Administrator > Advanced Computing Group University of Maine System > 244 Neville Hall (UMS Data Center) (207) 561-3574 > Orono ME 04469 steve.cousins at maine.edu > > > > ------------------------------------------------------------------------------ > > _______________________________________________ > xCAT-user mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/xcat-user > > > > ------------------------------------------------------------------------------ > > _______________________________________________ > xCAT-user mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/xcat-user > > -- ________________________________________________________________ Steve Cousins Supercomputer Engineer/Administrator Advanced Computing Group University of Maine System 244 Neville Hall (UMS Data Center) (207) 561-3574 Orono ME 04469 steve.cousins at maine.edu
------------------------------------------------------------------------------
_______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user
