The OS for the head node is CentOS 7
ifconfig -a:
enp11s0f0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 9000
inet 10.54.200.200 netmask 255.255.0.0 broadcast 10.54.255.255
inet6 fe80::225:90ff:fe18:c30e prefixlen 64 scopeid 0x20<link>
ether 00:25:90:18:c3:0e txqueuelen 1000 (Ethernet)
RX packets 4361702 bytes 3262025237 (3.0 GiB)
RX errors 0 dropped 170 overruns 170 frame 0
TX packets 2824086 bytes 1195929007 (1.1 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
device memory 0xfbe20000-fbe3ffff
enp11s0f1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 172.20.0.1 netmask 255.255.0.0 broadcast 172.20.255.255
inet6 fe80::225:90ff:fe18:c30f prefixlen 64 scopeid 0x20<link>
ether 00:25:90:18:c3:0f txqueuelen 1000 (Ethernet)
RX packets 4376023 bytes 669599743 (638.5 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 11575987 bytes 2473097440 (2.3 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
device memory 0xfbee0000-fbefffff
enp8s0f0: flags=4098<BROADCAST,MULTICAST> mtu 1500
ether 00:e0:ed:17:70:00 txqueuelen 1000 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
enp8s0f1: flags=4098<BROADCAST,MULTICAST> mtu 1500
ether 00:e0:ed:17:70:01 txqueuelen 1000 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
ib0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 65520
inet 10.55.50.100 netmask 255.255.0.0 broadcast 10.55.255.255
inet6 fe80::202:c903:7:f353 prefixlen 64 scopeid 0x20<link>
Infiniband hardware address can be incorrect! Please read BUGS section in
ifconfig(8).
infiniband
80:00:00:48:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00 txqueuelen 256
(InfiniBand)
RX packets 2407037 bytes 68324440907 (63.6 GiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 2894334 bytes 95158435534 (88.6 GiB)
TX errors 0 dropped 4 overruns 0 carrier 0 collisions 0
lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10<host>
loop txqueuelen 0 (Local Loopback)
RX packets 7685623 bytes 2146959369 (1.9 GiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 7685623 bytes 2146959369 (1.9 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
Networks table:
[root@gromit ~]# tabdump networks
#netname,net,mask,mgtifname,gateway,dhcpserver,tftpserver,nameservers,ntpservers,logservers,dynamicrange,staticrange,staticrangeincrement,nodehostname,ddnsdomain,vlanid,domain,comments,disable
"clusternet","172.20.0.0","255.255.0.0","enp11s0f1","<xcatmaster>","172.20.0.1","172.20.0.1","<xcatmaster>","172.20.0.1",,,"172.20.10.101-172.20.10.254",,,,,,,
"publicnet","10.54.0.0","255.255.0.0","enp11s0f0",,,,,,,,,,,,,,,
"172_21_0_0-255_255_0_0","172.21.0.0","255.255.0.0","ib0","<xcatmaster>",,"172.21.0.1",,,,,,,,,,,,
Site:
master is 127.0.0.1 which was not changed. Should it be 172.20.0.1?
nameserver too is 127.0.0.1 and unchanged.
xCAT version: 2.9.1
.
Do you know how the DHCP server picks up the information about what MAC
addresses are mapped to the IP addresses? I think that ultimately the
information comes from the mac and node and hosts tables but I mean what
files are the DHCP using to pick up that information. I don't see it in the
usual place.
Thanks a lot for your help Russell.
Steve
On Tue, Nov 3, 2015 at 10:41 PM, Russell Auld <[email protected]> wrote:
> What OS is the head node running?
> Can you show what the network settings on the head node are? E.g.:
> "ifconfig -a" or "ip addr show"
> Can you show the full output of the networks table?
> You will definitely need to change some things in the site table.
> nameservers and master to start with.
> Also, which version of xcat are you using?
>
> ------------------------------
> *From: *"Stephen Cousins" <[email protected]>
> *To: *"xCAT Users Mailing list" <[email protected]>
> *Sent: *Tuesday, November 3, 2015 3:16:09 PM
> *Subject: *Re: [xcat-user] Network change -> dhcpd: DHCPDISCOVER: no
> free leases
>
>
> Anything to look for specifically? Here is what tabdump site shows:
>
> #key,value,comments,disable
> "blademaxp","64",,
> "fsptimeout","0",,
> "installdir","/install",,
> "ipmimaxp","64",,
> "ipmiretries","3",,
> "ipmitimeout","2",,
> "consoleondemand","no",,
> "master","127.0.0.1",,
> "forwarders","$our-name-server",,
> "nameservers","127.0.0.1",,
> "maxssh","8",,
> "ppcmaxp","64",,
> "ppcretry","3",,
> "ppctimeout","0",,
> "powerinterval","0",,
> "syspowerinterval","0",,
> "sharedtftp","1",,
> "SNsyncfiledir","/var/xcat/syncfiles",,
> "nodesyncfiledir","/var/xcat/node/syncfiles",,
> "tftpdir","/tftpboot",,
> "xcatdport","3001",,
> "xcatiport","3002",,
> "xcatconfdir","/etc/xcat",,
> "timezone","America/New_York",,
> "useNmapfromMN","no",,
> "enableASMI","no",,
> "db2installloc","/mntdb2",,
> "databaseloc","/var/lib",,
> "sshbetweennodes","ALLGROUPS",,
> "dnshandler","ddns",,
> "vsftp","n",,
> "cleanupxcatpost","no",,
> "dhcplease","43200",,
> "auditnosyslog","0",,
> "dhcpinterfaces","enp11s0f1",,
> "domain","cluster",,
>
>
> Thanks,
>
> Steve
>
> On Tue, Nov 3, 2015 at 2:11 PM, Russell Auld <[email protected]> wrote:
>
>> Check the site table.
>>
>> On Nov 3, 2015 1:14 PM, Stephen Cousins <[email protected]> wrote:
>> >
>> > Hi,
>> >
>> > I had improperly set my network to 172.0.0.0/16 thinking that that was
>> in private space. I later found that 172.16.0.0/12 is the real private
>> space so I changed entries in all of the tables to 172.20.*.*. I also
>> changed entries in /etc/hosts, and then reran makedns -n and makedhcp -n.
>> After restarting everything DHCP starts up fine but when I boot a node it
>> comes up with entries like:
>> >
>> > Nov 3 12:50:49 gromit dhcpd: DHCPDISCOVER from 00:25:90:29:4b:40 via
>> enp11s0f1: network enp11s0f1: no free leases
>> >
>> > So, I seem to not have gotten everything changed. The networks table
>> has a staticrange of: 172.20.10.101-172.20.10.254:
>> >
>> >
>> "clusternet","172.20.0.0","255.255.0.0","enp11s0f1","<xcatmaster>","172.20.0.1","172.20.0.1","<xcatmaster>","172.20.0.1",,,"172.20.10.101-172.20.10.254",,,,,,,
>> >
>> >
>> > Here is what the generated dhcpd.conf file looks like:
>> >
>> >> #xCAT generated dhcp configuration
>> >>
>> >> authoritative;
>> >> option conf-file code 209 = text;
>> >> option space isan;
>> >> option isan-encap-opts code 43 = encapsulate isan;
>> >> option isan.iqn code 203 = string;
>> >> option isan.root-path code 201 = string;
>> >> option space gpxe;
>> >> option gpxe-encap-opts code 175 = encapsulate gpxe;
>> >> option gpxe.bus-id code 177 = string;
>> >> option user-class-identifier code 77 = string;
>> >> option gpxe.no-pxedhcp code 176 = unsigned integer 8;
>> >> option tcode code 101 = text;
>> >> option iscsi-initiator-iqn code 203 = string;
>> >> ddns-update-style interim;
>> >> ignore client-updates;
>> >> option client-architecture code 93 = unsigned integer 16;
>> >> option tcode "America/New_York";
>> >> option gpxe.no-pxedhcp 1;
>> >>
>> >> omapi-port 7911;
>> >> key xcat_key {
>> >> algorithm hmac-md5;
>> >> secret "==============my_secret===================";
>> >> };
>> >> omapi-key xcat_key;
>> >> class "pxe" {
>> >> match if substring (option vendor-class-identifier, 0, 9) =
>> "PXEClient";
>> >> ddns-updates off;
>> >> max-lease-time 600;
>> >> }
>> >> shared-network enp11s0f1 {
>> >> subnet 172.20.0.0 netmask 255.255.0.0 {
>> >> max-lease-time 43200;
>> >> min-lease-time 43200;
>> >> default-lease-time 43200;
>> >> option routers 172.20.0.1;
>> >> next-server 172.20.0.1;
>> >> option log-servers 172.20.0.1;
>> >> option ntp-servers 172.20.0.1;
>> >> option domain-name "cluster";
>> >> option domain-name-servers 172.20.0.1;
>> >> option domain-search "cluster";
>> >> zone cluster. {
>> >> primary 172.20.0.1; key xcat_key;
>> >> }
>> >> zone 20.172.IN-ADDR.ARPA. {
>> >> primary 172.20.0.1; key xcat_key;
>> >> }
>> >> if option user-class-identifier = "xNBA" and option
>> client-architecture = 00:00 { #x86, xCAT Network Boot Agent
>> >> always-broadcast on;
>> >> filename = "*MailScanner has detected a possible fraud attempt
>> from "172.20.0.1" claiming to be*
>> http://172.20.0.1/tftpboot/xcat/xnba/nets/172.20.0.0_16
>> <http://172.20.0.1/tftpboot/xcat/xnba/nets/172.20.0.0_16>";
>> >> } else if option user-class-identifier = "xNBA" and option
>> client-architecture = 00:09 { #x86, xCAT Network Boot Agent
>> >> filename = "*MailScanner has detected a possible fraud attempt
>> from "172.20.0.1" claiming to be*
>> http://172.20.0.1/tftpboot/xcat/xnba/nets/172.20.0.0_16.uefi
>> <http://172.20.0.1/tftpboot/xcat/xnba/nets/172.20.0.0_16.uefi>";
>> >> } else if option client-architecture = 00:00 { #x86
>> >> filename "xcat/xnba.kpxe";
>> >> } else if option vendor-class-identifier = "Etherboot-5.4" { #x86
>> >> filename "xcat/xnba.kpxe";
>> >> } else if option client-architecture = 00:07 { #x86_64 uefi
>> >> filename "xcat/xnba.efi";
>> >> } else if option client-architecture = 00:09 { #x86_64 uefi
>> alternative id
>> >> filename "xcat/xnba.efi";
>> >> } else if option client-architecture = 00:02 { #ia64
>> >> filename "elilo.efi";
>> >> } else if option client-architecture = 00:0e { #OPAL-v3
>> >> option conf-file = "*MailScanner has detected a possible fraud
>> attempt from "172.20.0.1" claiming to be*
>> http://172.20.0.1/tftpboot/pxelinux.cfg/p/172.20.0.0_16
>> <http://172.20.0.1/tftpboot/pxelinux.cfg/p/172.20.0.0_16>";
>> >> } else if substring(filename,0,1) = null { #otherwise, provide
>> yaboot if the client isn't specific
>> >> filename "/yaboot";
>> >> }
>> >> } # 172.20.0.0/255.255.0.0 subnet_end
>> >> } # enp11s0f1 nic_end
>> >>
>> > I'm not sure how the static MAC addresses come into play with xCAT. I
>> am used to static entries being like:
>> >
>> >>
>> >> host n101 {
>> >> hardware ethernet 00:25:90:29:4b:40;
>> >> fixed-address 172.20.10.101;
>> >> }
>> >>
>> >
>> > I see that I'll likely have issues with tftpd as well. I'll come try
>> to work through those when I get there.
>> >
>> > I guess I have two questions after all of this:
>> >
>> > 1. What do I need to do now to get things fixed?
>> > 2. What would have been the correct way to do what I wanted to do.
>> >
>> > Thanks for your continued help with this project.
>> >
>> > Steve
>> >
>> > --
>> > ________________________________________________________________
>> > Steve Cousins Supercomputer Engineer/Administrator
>> > Advanced Computing Group University of Maine System
>> > 244 Neville Hall (UMS Data Center) (207) 561-3574
>> > Orono ME 04469 steve.cousins at maine.edu
>> >
>>
>> ------------------------------------------------------------------------------
>> _______________________________________________
>> xCAT-user mailing list
>> [email protected]
>> https://lists.sourceforge.net/lists/listinfo/xcat-user
>>
>
>
>
> --
> ________________________________________________________________
> Steve Cousins Supercomputer Engineer/Administrator
> Advanced Computing Group University of Maine System
> 244 Neville Hall (UMS Data Center) (207) 561-3574
> Orono ME 04469 steve.cousins at maine.edu
>
>
>
> ------------------------------------------------------------------------------
>
> _______________________________________________
> xCAT-user mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/xcat-user
>
>
>
> ------------------------------------------------------------------------------
>
> _______________________________________________
> xCAT-user mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/xcat-user
>
>
--
________________________________________________________________
Steve Cousins Supercomputer Engineer/Administrator
Advanced Computing Group University of Maine System
244 Neville Hall (UMS Data Center) (207) 561-3574
Orono ME 04469 steve.cousins at maine.edu
------------------------------------------------------------------------------
_______________________________________________
xCAT-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/xcat-user
