The missing piece is nodeset. That will finally update the leases file. So, in general, you would want to: makehosts makedhcp nodeset
On Nov 4, 2015 9:26 AM, Stephen Cousins <[email protected]> wrote: > > Hi Russell, > > About the master and nameserver: they were both unchanged from prior to the > IP change and the manager is set up as a name server. I didn't change the > entries showing the 127.0.0.1 address and it was working previously so I > figured it would continue to work. I'll give it a try with 172.20.0.1 though. > > The /var/lib/dhcp/dhcpd.leases file had entries with the old IP's so I > figured that maybe that was the problem. I stopped dhcpd and moved the > dhcpd.leases to /tmp just to get it out of there thinking that when I started > dhcpd up again it would create a new one and populate it as nodes booted up. > I created a blank dhcpd.leases file and started up dhcpd but still the same > thing when. > > I thought about it more and realized that that file was the missing piece > that I was asking about. That file is what maps the MAC addresses to the > static IP's. So, I moved the original dhcpd.leases file back and ran > >> sed -i -e s/172.0.10/172.20.10/g dhcpd.leases > > > and then restarted dhcpd. Success! The nodes boot up with the correct new IP. > > So, I guess my new question is: What is supposed to create or recreate the > dhcpd.leases file? Presumably it would be makedhcp but that doesn't seem to > be doing it. > > For completeness, I do have entries in the mac table and I did run chdef for > each node. > > Thanks very much for your help. It's always helpful to have someone else look > at things. Especially when the original eyes (mine) don't know exactly what > to look for. > > Best regards, > > Steve > > On Wed, Nov 4, 2015 at 8:34 AM, Russell Auld <[email protected]> wrote: >> >> You will definitely need to change "master" to the IP address that the nodes >> will see - 172.20.0.1 >> You should also set the "nameservers" to something that actually serves DNS. >> It wouldn't be a bad thing to run a DNS server on the xCAT master node, but >> you don't absolutely have to. >> Everything else looks ok, but yes, you're right that you do need to tell >> xCAT about the nodes and their MACs. >> Do you see anything in /var/lib/dhcpd.leases? >> Do you have any nodes defined? (nodels command). >> You either need to statically define the nodes, via something like "chdef >> n101 mac=00:25:90:29:4b:40 groups=all" >> or use auto node discovery - but something has to set the MAC addresses in >> xCAT. >> >> >> ________________________________ >> From: "Stephen Cousins" <[email protected]> >> To: "xCAT Users Mailing list" <[email protected]> >> Sent: Tuesday, November 3, 2015 11:46:48 PM >> Subject: Re: [xcat-user] {Disarmed} Re: Network change -> dhcpd: >> DHCPDISCOVER: no free leases >> >> >> The OS for the head node is CentOS 7 >> >> ifconfig -a: >>> >>> enp11s0f0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 9000 >>> inet 10.54.200.200 netmask 255.255.0.0 broadcast 10.54.255.255 >>> inet6 fe80::225:90ff:fe18:c30e prefixlen 64 scopeid 0x20<link> >>> ether 00:25:90:18:c3:0e txqueuelen 1000 (Ethernet) >>> RX packets 4361702 bytes 3262025237 (3.0 GiB) >>> RX errors 0 dropped 170 overruns 170 frame 0 >>> TX packets 2824086 bytes 1195929007 (1.1 GiB) >>> TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 >>> device memory 0xfbe20000-fbe3ffff >>> >>> enp11s0f1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 >>> inet 172.20.0.1 netmask 255.255.0.0 broadcast 172.20.255.255 >>> inet6 fe80::225:90ff:fe18:c30f prefixlen 64 scopeid 0x20<link> >>> ether 00:25:90:18:c3:0f txqueuelen 1000 (Ethernet) >>> RX packets 4376023 bytes 669599743 (638.5 MiB) >>> RX errors 0 dropped 0 overruns 0 frame 0 >>> TX packets 11575987 bytes 2473097440 (2.3 GiB) >>> TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 >>> device memory 0xfbee0000-fbefffff >>> >>> enp8s0f0: flags=4098<BROADCAST,MULTICAST> mtu 1500 >>> ether 00:e0:ed:17:70:00 txqueuelen 1000 (Ethernet) >>> RX packets 0 bytes 0 (0.0 B) >>> RX errors 0 dropped 0 overruns 0 frame 0 >>> TX packets 0 bytes 0 (0.0 B) >>> TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 >>> >>> enp8s0f1: flags=4098<BROADCAST,MULTICAST> mtu 1500 >>> ether 00:e0:ed:17:70:01 txqueuelen 1000 (Ethernet) >>> RX packets 0 bytes 0 (0.0 B) >>> RX errors 0 dropped 0 overruns 0 frame 0 >>> TX packets 0 bytes 0 (0.0 B) >>> TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 >>> >>> ib0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 65520 >>> inet 10.55.50.100 netmask 255.255.0.0 broadcast 10.55.255.255 >>> inet6 fe80::202:c903:7:f353 prefixlen 64 scopeid 0x20<link> >>> Infiniband hardware address can be incorrect! Please read BUGS section in >>> ifconfig(8). >>> infiniband >>> 80:00:00:48:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00 txqueuelen 256 >>> (InfiniBand) >>> RX packets 2407037 bytes 68324440907 (63.6 GiB) >>> RX errors 0 dropped 0 overruns 0 frame 0 >>> TX packets 2894334 bytes 95158435534 (88.6 GiB) >>> TX errors 0 dropped 4 overruns 0 carrier 0 collisions 0 >>> >>> lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536 >>> inet 127.0.0.1 netmask 255.0.0.0 >>> inet6 ::1 prefixlen 128 scopeid 0x10<host> >>> loop txqueuelen 0 (Local Loopback) >>> RX packets 7685623 bytes 2146959369 (1.9 GiB) >>> RX errors 0 dropped 0 overruns 0 frame 0 >>> TX packets 7685623 bytes 2146959369 (1.9 GiB) >>> TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 >> >> >> >> Networks table: >>> >>> [root@gromit ~]# tabdump networks >>> #netname,net,mask,mgtifname,gateway,dhcpserver,tftpserver,nameservers,ntpservers,logservers,dynamicrange,staticrange,staticrangeincrement,nodehostname,ddnsdomain,vlanid,domain,comments,disable >>> "clusternet","172.20.0.0","255.255.0.0","enp11s0f1","<xcatmaster>","172.20.0.1","172.20.0.1","<xcatmaster>","172.20.0.1",,,"172.20.10.101-172.20.10.254",,,,,,, >>> "publicnet","10.54.0.0","255.255.0.0","enp11s0f0",,,,,,,,,,,,,,, >>> "172_21_0_0-255_255_0_0","172.21.0.0","255.255.0.0","ib0","<xcatmaster>",,"172.21.0.1",,,,,,,,,,,, >> >> >> Site: >>> >>> master is 127.0.0.1 which was not changed. Should it be 172.20.0.1? >>> >>> nameserver too is 127.0.0.1 and unchanged. >>> >> xCAT version: 2.9.1 >> >> . >> >> Do you know how the DHCP server picks up the information about what MAC >> addresses are mapped to the IP addresses? I think that ultimately the >> information comes from the mac and node and hosts tables but I mean what >> files are the DHCP using to pick up that information. I don't see it in the >> usual place. >> >> Thanks a lot for your help Russell. >> >> Steve >> >> >> On Tue, Nov 3, 2015 at 10:41 PM, Russell Auld <[email protected]> wrote: >>> >>> What OS is the head node running? >>> Can you show what the network settings on the head node are? E.g.: >>> "ifconfig -a" or "ip addr show" >>> Can you show the full output of the networks table? >>> You will definitely need to change some things in the site table. >>> nameservers and master to start with. >>> Also, which version of xcat are you using? >>> >>> ________________________________ >>> From: "Stephen Cousins" <[email protected]> >>> To: "xCAT Users Mailing list" <[email protected]> >>> Sent: Tuesday, November 3, 2015 3:16:09 PM >>> Subject: Re: [xcat-user] Network change -> dhcpd: DHCPDISCOVER: no free >>> leases >>> >>> >>> Anything to look for specifically? Here is what tabdump site shows: >>> >>>> #key,value,comments,disable >>>> "blademaxp","64",, >>>> "fsptimeout","0",, >>>> "installdir","/install",, >>>> "ipmimaxp","64",, >>>> "ipmiretries","3",, >>>> "ipmitimeout","2",, >>>> "consoleondemand","no",, >>>> "master","127.0.0.1",, >>>> "forwarders","$our-name-server",, >>>> "nameservers","127.0.0.1",, >>>> "maxssh","8",, >>>> "ppcmaxp","64",, >>>> "ppcretry","3",, >>>> "ppctimeout","0",, >>>> "powerinterval","0",, >>>> "syspowerinterval","0",, >>>> "sharedtftp","1",, >>>> "SNsyncfiledir","/var/xcat/syncfiles",, >>>> "nodesyncfiledir","/var/xcat/node/syncfiles",, >>>> "tftpdir","/tftpboot",, >>>> "xcatdport","3001",, >>>> "xcatiport","3002",, >>>> "xcatconfdir","/etc/xcat",, >>>> "timezone","America/New_York",, >>>> "useNmapfromMN","no",, >>>> "enableASMI","no",, >>>> "db2installloc","/mntdb2",, >>>> "databaseloc","/var/lib",, >>>> "sshbetweennodes","ALLGROUPS",, >>>> "dnshandler","ddns",, >>>> "vsftp","n",, >>>> "cleanupxcatpost","no",, >>>> "dhcplease","43200",, >>>> "auditnosyslog","0",, >>>> "dhcpinterfaces","enp11s0f1",, >>>> "domain","cluster",, >>> >>> >>> Thanks, >>> >>> Steve >>> >>> On Tue, Nov 3, 2015 at 2:11 PM, Russell Auld <[email protected]> wrote: >>>> >>>> Check the site table. >>>> >>>> On Nov 3, 2015 1:14 PM, Stephen Cousins <[email protected]> wrote: >>>> > >>>> > Hi, >>>> > >>>> > I had improperly set my network to 172.0.0.0/16 thinking that that was >>>> > in private space. I later found that 172.16.0.0/12 is the real private >>>> > space so I changed entries in all of the tables to 172.20.*.*. I also >>>> > changed entries in /etc/hosts, and then reran makedns -n and makedhcp >>>> > -n. After restarting everything DHCP starts up fine but when I boot a >>>> > node it comes up with entries like: >>>> > >>>> > Nov 3 12:50:49 gromit dhcpd: DHCPDISCOVER from 00:25:90:29:4b:40 via >>>> > enp11s0f1: network enp11s0f1: no free leases >>>> > >>>> > So, I seem to not have gotten everything changed. The networks table >>>> > has a staticrange of: 172.20.10.101-172.20.10.254: >>>> > >>>> > "clusternet","172.20.0.0","255.255.0.0","enp11s0f1","<xcatmaster>","172.20.0.1","172.20.0.1","<xcatmaster>","172.20.0.1",,,"172.20.10.101-172.20.10.254",,,,,,, >>>> > >>>> > >>>> > Here is what the generated dhcpd.conf file looks like: >>>> > >>>> >> #xCAT generated dhcp configuration >>>> >> >>>> >> authoritative; >>>> >> option conf-file code 209 = text; >>>> >> option space isan; >>>> >> option isan-encap-opts code 43 = encapsulate isan; >>>> >> option isan.iqn code 203 = string; >>>> >> option isan.root-path code 201 = string; >>>> >> option space gpxe; >>>> >> option gpxe-encap-opts code 175 = encapsulate gpxe; >>>> >> option gpxe.bus-id code 177 = string; >>>> >> option user-class-identifier code 77 = string; >>>> >> option gpxe.no-pxedhcp code 176 = unsigned integer 8; >>>> >> option tcode code 101 = text; >>>> >> option iscsi-initiator-iqn code 203 = string; >>>> >> ddns-update-style interim; >>>> >> ignore client-updates; >>>> >> option client-architecture code 93 = unsigned integer 16; >>>> >> option tcode "America/New_York"; >>>> >> option gpxe.no-pxedhcp 1; >>>> >> >>>> >> omapi-port 7911; >>>> >> key xcat_key { >>>> >> algorithm hmac-md5; >>>> >> secret "==============my_secret==================="; >>>> >> }; >>>> >> omapi-key xcat_key; >>>> >> class "pxe" { >>>> >> match if substring (option vendor-class-identifier, 0, 9) = >>>> >> "PXEClient"; >>>> >> ddns-updates off; >>>> >> max-lease-time 600; >>>> >> } >>>> >> shared-network enp11s0f1 { >>>> >> subnet 172.20.0.0 netmask 255.255.0.0 { >>>> >> max-lease-time 43200; >>>> >> min-lease-time 43200; >>>> >> default-lease-time 43200; >>>> >> option routers 172.20.0.1; >>>> >> next-server 172.20.0.1; >>>> >> option log-servers 172.20.0.1; >>>> >> option ntp-servers 172.20.0.1; >>>> >> option domain-name "cluster"; >>>> >> option domain-name-servers 172.20.0.1; >>>> >> option domain-search "cluster"; >>>> >> zone cluster. { >>>> >> primary 172.20.0.1; key xcat_key; >>>> >> } >>>> >> zone 20.172.IN-ADDR.ARPA. { >>>> >> primary 172.20.0.1; key xcat_key; >>>> >> } >>>> >> if option user-class-identifier = "xNBA" and option >>>> >> client-architecture = 00:00 { #x86, xCAT Network Boot Agent >>>> >> always-broadcast on; >>>> >> filename = "MailScanner has detected a possible fraud attempt >>>> >> from "172.20.0.1" claiming to be >>>> >> http://172.20.0.1/tftpboot/xcat/xnba/nets/172.20.0.0_16";; >>>> >> } else if option user-class-identifier = "xNBA" and option >>>> >> client-architecture = 00:09 { #x86, xCAT Network Boot Agent >>>> >> filename = "MailScanner has detected a possible fraud attempt >>>> >> from "172.20.0.1" claiming to be >>>> >> http://172.20.0.1/tftpboot/xcat/xnba/nets/172.20.0.0_16.uefi";; >>>> >> } else if option client-architecture = 00:00 { #x86 >>>> >> filename "xcat/xnba.kpxe"; >>>> >> } else if option vendor-class-identifier = "Etherboot-5.4" { #x86 >>>> >> filename "xcat/xnba.kpxe"; >>>> >> } else if option client-architecture = 00:07 { #x86_64 uefi >>>> >> filename "xcat/xnba.efi"; >>>> >> } else if option client-architecture = 00:09 { #x86_64 uefi >>>> >> alternative id >>>> >> filename "xcat/xnba.efi"; >>>> >> } else if option client-architecture = 00:02 { #ia64 >>>> >> filename "elilo.efi"; >>>> >> } else if option client-architecture = 00:0e { #OPAL-v3 >>>> >> option conf-file = "MailScanner has detected a possible fraud >>>> >> attempt from "172.20.0.1" claiming to be >>>> >> http://172.20.0.1/tftpboot/pxelinux.cfg/p/172.20.0.0_16";; >>>> >> } else if substring(filename,0,1) = null { #otherwise, provide >>>> >> yaboot if the client isn't specific >>>> >> filename "/yaboot"; >>>> >> } >>>> >> } # 172.20.0.0/255.255.0.0 subnet_end >>>> >> } # enp11s0f1 nic_end >>>> >> >>>> > I'm not sure how the static MAC addresses come into play with xCAT. I am >>>> > used to static entries being like: >>>> > >>>> >> >>>> >> host n101 { >>>> >> hardware ethernet 00:25:90:29:4b:40; >>>> >> fixed-address 172.20.10.101; >>>> >> } >>>> >> >>>> > >>>> > I see that I'll likely have issues with tftpd as well. I'll come try >>>> > to work through those when I get there. >>>> > >>>> > I guess I have two questions after all of this: >>>> > >>>> > 1. What do I need to do now to get things fixed? >>>> > 2. What would have been the correct way to do what I wanted to do. >>>> > >>>> > Thanks for your continued help with this project. >>>> > >>>> > Steve >>>> > >>>> > -- >>>> > ________________________________________________________________ >>>> > Steve Cousins Supercomputer Engineer/Administrator >>>> > Advanced Computing Group University of Maine System >>>> > 244 Neville Hall (UMS Data Center) (207) 561-3574 >>>> > Orono ME 04469 steve.cousins at maine.edu >>>> > >>>> ------------------------------------------------------------------------------ >>>> _______________________________________________ >>>> xCAT-user mailing list >>>> [email protected] >>>> https://lists.sourceforge.net/lists/listinfo/xcat-user >>> >>> >>> >>> >>> -- >>> ________________________________________________________________ >>> Steve Cousins Supercomputer Engineer/Administrator >>> Advanced Computing Group University of Maine System >>> 244 Neville Hall (UMS Data Center) (207) 561-3574 >>> Orono ME 04469 steve.cousins at maine.edu >>> >>> >>> ------------------------------------------------------------------------------ >>> >>> _______________________________________________ >>> xCAT-user mailing list >>> [email protected] >>> https://lists.sourceforge.net/lists/listinfo/xcat-user >>> >>> >>> ------------------------------------------------------------------------------ >>> >>> _______________________________________________ >>> xCAT-user mailing list >>> [email protected] >>> https://lists.sourceforge.net/lists/listinfo/xcat-user >>> >> >> >> >> -- >> ________________________________________________________________ >> Steve Cousins Supercomputer Engineer/Administrator >> Advanced Computing Group University of Maine System >> 244 Neville Hall (UMS Data Center) (207) 561-3574 >> Orono ME 04469 steve.cousins at maine.edu >> >> >> ------------------------------------------------------------------------------ >> >> _______________________________________________ >> xCAT-user mailing list >> [email protected] >> https://lists.sourceforge.net/lists/listinfo/xcat-user >> >> >> ------------------------------------------------------------------------------ >> >> _______________________________________________ >> xCAT-user mailing list >> [email protected] >> https://lists.sourceforge.net/lists/listinfo/xcat-user >> > > > > -- > ________________________________________________________________ > Steve Cousins Supercomputer Engineer/Administrator > Advanced Computing Group University of Maine System > 244 Neville Hall (UMS Data Center) (207) 561-3574 > Orono ME 04469 steve.cousins at maine.edu > ------------------------------------------------------------------------------ _______________________________________________ xCAT-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/xcat-user
