NMC: Stale session appears in the NetWorker Management Console (NMC) monitoring tab

           

   Article Number:     534894                                   Article Version: 2     Article Type:    Break Fix 
   

 


Product:

 

NetWorker,NetWorker Management Console,NetWorker Management Console 9.2,NetWorker Management Console 9.1,NetWorker Management Console 9.0

 

Issue:

 

 

Symptoms:   
    Backup sessions appears in Monitoring as they are running but they have completed.   
    jobkill command and nsrwatch confirms that these sessions are stale.   
   
    When these stale sessions are shown, the following error messages appeared several times in the NMC server's GSTD.raw   

      Linux: /opt/lgtonmc/logs/gstd.raw     
      Windows: ..\Program Files\EMC NetWorker\Management\GST\logs\gstd.raw   
   
      unknown unknown LOG unrendered Can't open service gstSnmpTrapd: The specified service does not exist as an installed service.gstd NSR warning snmp: ERROR: snmp trap server exited unexpectedly. Possible reasons include: trapd port is already in use gstd NSR warning unable to launch EMC GST Trap Handler unknown unknown LOG unrendered Can't open service gstSnmpTrapd: The specified service does not exist as an installed service.gstd NSR notice nsm: Initial jobs info RPC succeeded for server: networker_server.emc.com gstd NSR warning snmp: ERROR: snmp trap server exited unexpectedly. Possible reasons include: trapd port is already in use 0 5/18/2019 8:52:19 AM  2 0 0 17140 16936 0 nmcserver.emc.com gstd NSR warning unable to launch EMC GST Trap Handler gstd NSR error Shutdown GST SNMP trap service after detecting excessive number of traps. gstd NSR error Delete all the trap files (*.dat) in NMC server's logs directory and restart the NMC server to enable SNMP trap monitoring.    
Note: the gstd.raw can be rendered with nsr_render_log /path/to/gstd.raw > gstd.out 2<&1   
   
    In the NMC server's logs directory it was detcted also several files names gstd_trap_<IP_address>.dat   
      Linux: /opt/lgtonmc/logs/     
      Windows: ..\Program Files\EMC NetWorker\Management\GST\logs\   
   
Directory of D:\Program Files\EMC NetWorker\Management\GST\logs05/30/2019  02:01 PM    <DIR>          .05/30/2019  02:01 PM    <DIR>          ..05/30/2019  12:22 PM         2,349,479 gstd.log05/30/2019  02:06 PM         2,273,707 gstd.raw01/04/2019  12:28 PM             1,580 gstdbinit.log03/22/2019  09:07 AM        14,556,943 gstd_190326_105318.raw05/13/2019  11:15 AM               260 gstd_trap_<IP_address>(via.dat03/25/2019  02:57 PM                58 gstd_trap_<IP_address>(via.dat05/17/2019  08:13 AM         4,571,676 gstd_trap_<IP_address>(via.dat03/01/2019  05:52 PM               130 gstd_trap_<IP_address>(via.dat05/13/2019  06:48 PM                39 gstd_trap_<IP_address>(via.dat05/16/2019  01:02 AM                80 gstd_trap_<IP_address>(via.dat05/17/2019  04:22 AM            20,807 gstd_trap_<IP_address>(via.dat03/20/2019  05:26 PM               546 gstd_trap_<IP_address>(via.dat05/17/2019  08:03 AM             9,382 gstd_trap_<IP_address>(via.dat02/24/2019  05:03 PM                78 gstd_trap_<IP_address>(via.dat02/24/2019  05:03 PM               117 gstd_trap_<IP_address>(via.dat05/16/2019  03:36 PM             1,403 gstd_trap_<IP_address>(via.dat05/16/2019  05:31 PM             7,924 gstd_trap_<IP_address>(via.dat05/16/2019  02:47 PM             9,386 gstd_trap_<IP_address>(via.dat03/04/2019  12:21 PM               128 gstd_trap_<IP_address>(via.dat03/25/2019  11:12 AM                64 gstd_trap_<IP_address>(via.dat    
    * More than 200 files were detected.                                                           

 

 

Cause:

 

 

The failure on EMC GST Trap handler service, prevented the deletion of the trap files.   
    The excessive number of traps have affected other GST services.
                                                           

 

 

Resolution:

 

 

Delete all the trap files (*.dat) in NMC server's logs directory and restart the NMC server to enable SNMP trap monitoring.    

      Linux: service gst restart     
      Windowsnet stop gstd && net start gstd