VxRack-SDDC: SDDC Controller reporting "Activation of org.freedesktop.systemd1 timed out" when executing commands

           

   Article Number:     528974                                   Article Version: 3     Article Type:    Break Fix 
   

 


Product:

 

VxRack SDDC,VxRack SDDC 14G-1,VXRack System 1000 SDDC

 

Issue:

 

 

- SDDC Controller reports several services are crashed   
    SCSCLI> show -servicestate all     
                   SERVICE       SERVICE STATE       PROCESS STATE     
               unbound-dns             unknown             crashed     
                  postgres             unknown             crashed     
                 cassandra             unknown             crashed     
                 zookeeper             unknown             crashed     
                bringup-ui      decommissioned             stopped     
                       hms             unknown             crashed     
                       vrm             unknown             crashed     
                   bringup             unknown             crashed     
                       pug             unknown             crashed
   
    - Manually restarting services fails   
    SCSCLI> service -start vrm     
      starting vrm...     
      SCS failed to start service vrm
   
    - Using systemctl to restart services fails with same error message "Activation of org.freedesktop.systemd1 timed out"   
    - Reboot of the VM fails with same error message :   
    Failed to start reboot.target: Activation of org.freedesktop.systemd1 timed out     
      Failed to open /dev/initctl: No such device or address     
      Failed to talk to init daemon.
   
    - Systemd version and release   
    root@sddc-manager-controller [ ~ ]# /usr/lib/systemd/systemd --version     
      systemd 228     
      +PAM -AUDIT -SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS -ACL +XZ -LZ4 -SECCOMP +BLKID -ELFUTILS +KMOD -IDN     
      root@sddc-manager-controller [ ~ ]# rpm -qa  | grep systemd     
      systemd-228-44.ph1.x86_64
                                                           

 

 

Cause:

 

 

Issue due to kernel bug on systemd:   
    https://access.redhat.com/discussions/3536621
                                                           

 

 

Resolution:

 

 

As systemd is not responding, so no further command will work.   
    - Snapshot of the SDDC Controller VMower   
    - Power off VM via web client   
    - Power on again VM.