ViPR Controller: VPLEX metering task fails with "Connection timed out"

           

   Article Number:     537528                                   Article Version: 2     Article Type:    Break Fix 
   

 


Product:

 

ViPR Controller,ViPR Controller Controller 3.6 SP2,ViPR Controller Controller 3.6 SP1,ViPR Controller Controller 3.6,ViPR Controller Controller 3.5

 

Issue:

 

 

ViPR Controller automatically runs a VPLEX metering task once an hour by default.     
      These tasks may fail or go into a pending state.
   
   
   
    ViPR-C controllersvc log :    
   
    vipr1 ayvcstop01 controllersvc 2019-09-24 13:46:54,385 [286|vplex|Metering|10.242.185.173|fa3e6322-dde0-4c87-abb7-76911a70364b] ERROR SSHCommandExecutor.java (line 151) SSH 'ls -1 /var/log/VPlex/cli/*PERPETUAL_vplex_sys_perf*log' command failed: com.iwave.utility.ssh.SSHException: com.jcraft.jsch.JSchException: java.net.ConnectException: Connection timed out (Connection timed out) at com.iwave.utility.ssh.SSHCommandExecutor.connect(SSHCommandExecutor.java:118)
                                                           

 

 

Cause:

 

 

During VPLEX Metering tasks, ViPR Controller attempts to SSH into the VPLEX management server and run the following command :   
   
    'ls -1 /var/log/VPlex/cli/*PERPETUAL_vplex_sys_perf*log'   
   
    When running the command manually via ssh outside of VIPR-C,    
    sh username@vplex_ip_addr 'ls -1 /var/log/VPlex/cli/*PERPETUAL_vplex_sys_perf*log', the command hangs and times out.   
   
    This connection issue is a result of a Network/Firewall issue and not VIPR Controller related. 
                                                           

 

 

Resolution:

 

 

   

      ViPR Controller Metering tasks are failing as a result of the SSH connection time-out.     
      The SSH connection issue needs to be resolved by the local Network/Firewall team.     
          

                                                             

 

 

Notes:

 

 

controllersvc-discovery   
    vipr4 vipr4 controllersvc-discovery 2019-09-25 07:30:48,270 [355|vplex|Metering|xxx.xxx.xxx.xxx|bf014f3b-607d-48ff-8557-0c178f587ae1] ERROR  DataCollectionJobConsumer.java (line 104) Metering job failed for urn:storageos:StorageSystem:0cd3fa7a-4f76-4aff-ad69-ee6cffbe3f1c:vdc1--->      
      com.iwave.ext.command.CommandException: com.iwave.utility.ssh.SSHException: com.jcraft.jsch.JSchException: java.net.ConnectException: Connection timed out (Connection timed out)     
          at com.iwave.utility.ssh.SSHCommandExecutor.executeCommand(SSHCommandExecutor.java:152)     
      ...     
      vipr4 vipr4 controllersvc-discovery 2019-09-25 07:30:48,415 [355|vplex|Metering|xxx.xxx.xxx.xxx|bf014f3b-607d-48ff-8557-0c178f587ae1]  INFO  DataCollectionTaskCompleter.java (line 68) Failed JobType: Metering, Class: class com.emc.storageos.db.client.model.StorageSystem