ECS: Getrackinfo showing Master Node other than Node 1 or Node is missing from getrackinfo

           

   Article Number:     538680                                   Article Version: 5     Article Type:    Break Fix 
   

 


Product:

 

ECS Appliance

 

Issue:

 

 

Issue 1: getrackinfo showing (MA) master node is node 2 not node 1.   

admin@node01:~> getrackinfoNode private      Node              Public                                  BMC                                     Ip Address        Id       Status   Mac                 Ip Address          Mac                 Ip Address          Node Name===============   ======   ======   =================   =================   =================   =================   =========192.168.219.1     1        SA       e4:43:4b:3c:dd:62   x.x.x.x             4c:d9:8f:38:c2:79   192.168.219.101     provo-red192.168.219.2     2        MA       e4:43:4b:3c:de:b2   x.x.x.x             4c:d9:8f:36:f0:c7   192.168.219.102     sandy-red192.168.219.3     3        SA       e4:43:4b:3b:e7:72   x.x.x.x             4c:d9:8f:3b:48:2b   192.168.219.103     orem-red192.168.219.4     4        SA       e4:43:4b:3c:ee:42   x.x.x.x             4c:d9:8f:3c:16:e9   192.168.219.104     ogden-red    
   
    Issue 2: Node stuck in LI status missing from getrackinfo on master node:   
         
  1.         Confirm if you are having the LI status issue by checking getrackinfo on the master node:     
  2.    
Command:   
    # getrackinfo   
    Example:   
admin@node1~>getrackinfo Node private      Node              Public                                  RMM                                    Ip Address        Id       Status   Mac                 Ip Address          Mac                 Ip Address          Node Name===============   ======   ======   =================   =================   =================   =================   =========192.168.219.1     1        MA       00:1e:67:9e:f9:5e   x.x.x.x             00:1e:67:69:8d:8f   x.x.x.x             provo-red192.168.219.2     2        SA       00:1e:67:93:4b:3c   x.x.x.x             00:1e:67:5a:4b:72   x.x.x.x             sandy-red192.168.219.4     4        SA       00:1e:67:9e:f8:7e   x.x.x.x             00:1e:67:69:83:53   x.x.x.x             ogden-redStatus:M - Master, S - Slave, L - LocalE - EpoxyI - Initializing, U - Updating, A - ActiveP - On, O - Off! - Warning/Error list:    1 - Hostname set to default hostname set by installer    2 - private interface is down or the private ip address has not been installed in the kernel(check management interface connection)    3 - Port ID has not been assigned(check management interface connection or lldpd.service then restart emc-nan.service).    4 - Version of NAN is incompatible with the rackMaster.  Node is in read only mode    
   
         
  1.         Confirm getrackinfo from the missing node:     
  2.    
Commands:   
    # getrackinfo     
      # getrackinfo -s
   
    Example:   
admin@node3~>getrackinfo *******************************************************************************Rack Master Service is currently unavailable for the following reasons. 1) emc-nan.service or nan.service has been recently started or restarted.2) private interface is down(check connection then restart emc-nan.service). 3) lldpd service may not be running or lldp advertisement is not enabled on   private interface's switch port.   (check connection then restart emc-nan.service)The local information will be displayed instead.******************************************************************************* Node private      Node              Public                                  RMM                                    Ip Address        Id       Status   Mac                 Ip Address          Mac                 Ip Address          Node Name===============   ======   ======   =================   =================   =================   =================   =========192.168.219.3     3        LI       00:1e:67:9f:01:c6   x.x.x.x             00:1e:67:4d:a4:13   x.x.x.x             orem-redStatus:M - Master, S - Slave, L - LocalE - EpoxyI - Initializing, U - Updating, A - ActiveP - On, O - Off! - Warning/Error list:    1 - Hostname set to default hostname set by installer    2 - private interface is down or the private ip address has not been installed in the kernel(check management interface connection)    3 - Port ID has not been assigned(check management interface connection or lldpd.service then restart emc-nan.service).    4 - Version of NAN is incompatible with the rackMaster.  Node is in read only mode admin@node3~>getrackinfo -s *******************************************************************************Rack Master Service is currently unavailable for the following reasons.1) emc-nan.service or nan.service has been recently started or restarted.2) private interface is down(check connection then restart emc-nan.service).3) lldpd service may not be running or lldp advertisement is not enabled on   private interface's switch port.   (check connection then restart emc-nan.service)The local information will be displayed instead.******************************************************************************* Rack Master unavailable: Try again later!Reason: [Errno 111] Connection refused    
   
         
  1.         Cannot ssh to the master.rack from the node missing from getrackinfo:     
  2.    
   
admin@node3~>ssh master.rack ssh: Could not resolve hostname master.rack: Name or service not known    
   
                                                                

 

 

Cause:

 

 

For both issues you will see the both nodes have the rack master IP address.  (Note: the rackmaster IP address is 192.168.219.254)   
    Command:   
    # viprexec " ip ad show private | grep 192.168.219.254/24"   
    Example:   

admin@ecsnode1:~> viprexec " ip ad show private | grep 192.168.219.254/24"Output from host : 192.168.219.1    inet 192.168.219.254/24 brd 192.168.219.255 scope global secondary privateOutput from host : 192.168.219.2Output from host : 192.168.219.3    inet 192.168.219.254/24 brd 192.168.219.255 scope global secondary privateOutput from host : 192.168.219.4    
   
   
    ​​                                                           

 

 

Change:

 

 

This is a known issue and Dell EMC is reviewing the cause at this time.                                                           

 

 

Resolution:

 

 

Please create an SR and note this KB 538680 for resolution.   
     
                                                           

 

 

Notes:

 

 

   
    Subscribe to product updates?       
        You can subscribe to updates by following the instructions in the Knowledge Article below:
   
    DELL EMC: How to subscribe to Product Pages - Dell EMC Support?