VPlex: ERROR Failed to flush writer

           

   Article Number:     537982                                   Article Version: 2     Article Type:    Break Fix 
   

 


Product:

 

VPLEX for All Flash,VPLEX GeoSynchrony,VPLEX GeoSynchrony 5.4 Service Pack 1,VPLEX GeoSynchrony 5.4 Service Pack 1 Patch 1,VPLEX GeoSynchrony 5.4 Service Pack 1 Patch 3,VPLEX GeoSynchrony 5.4 Service Pack 1 Patch 4

 

Issue:

 

 

Issue: ERROR Failed to flush writer   
   
    In VPlex health check issue is reporting as "Error failed to flush Writer"   
   
    VPlexcli:/> health-check     
      log4j:ERROR Failed to flush writer,       
        cause: No space left on device
     
      Product Version: 5.5.2.02.00.03     
      Product Type: Metro     
      WAN Connectivity Type: FC     
      Hardware Type: VS2     
      Cluster Size: 2 engines     
      Cluster TLA:     
      cluster-1: CKM00xxxxxxxxx     
      cluster-2: CKM00xxxxxxxxx     
     
      Cluster    Cluster  Oper   Health    Connected  Expelled  Local-com       
      Name       ID       State  State                                          
      ---------  -------  -----  --------  ---------  --------  ---------       
      cluster-1  1        ok     ok        True       False     ok     
      cluster-2  2        ok     degraded  True       False     ok 
   
   
          
       
                                                           

 

 

Cause:

 

 

No space left on /var/log directory partition level reached to 100%   
   
    service@vplexnkdc01:~> df -h     
      Filesystem      Size  Used Avail Use% Mounted on     
      /dev/sda5        20G  7.8G   11G  44% /     
      udev            1.9G  184K  1.9G   1% /dev     
      tmpfs           1.9G     0  1.9G   0% /dev/shm     
      /dev/sda1       504M   76M  403M  16% /boot     
      /dev/sda7        16G   16G     0 100% /var/log   <<<<<<<<<<<<<<<<<<     
      /dev/sda8        44G   27G   16G  64% /diag     
      /dev/sda9       9.9G  151M  9.2G   2% /data
                                                           

 

 

Change:

 

 

Clean up will be required to reduce the partition level for /var/log directory.                                                           

 

 

Resolution:

 

 

To check the partition usage, type the "df-h" command at the management server prompt:   
   
    Service@ManagementServer:~> df-h     
      Filesystem      Size  Used Avail Use% Mounted on     
      /dev/sda5        20G  7.8G   11G  44% /     
      udev            1.9G  184K  1.9G   1% /dev     
      tmpfs           1.9G     0  1.9G   0% /dev/shm     
      /dev/sda1       504M   76M  403M  16% /boot     
      /dev/sda7        16G   16G     0 100% /var/log    <<<<<<<<<<<<<<<     
      /dev/sda8        44G   27G   16G  64% /diag     
      /dev/sda9       9.9G  151M  9.2G   2% /data
   
   
    Troubleshooting steps:   
   
    1) Refer to the below knowledge base article link to reduce the partition level:   
   
    VPLEX: 0x8a4a91fa / 0x8a4a31fb Management Server partitions full or exceeded xx percent threshold limit   
   
    If the /var/log utilization remains above the threshold, after following Knowledge base article: 457313, please follow step 2   
   
    2) There could be more than one issue which have caused /var/log/ folder on the management server fills to 100% due to net-snmpd.log not rotating properly. Please verify the net-snmpd.log log utilization on "/var/log" context, if the net-snmpd.log consumes more utilization, must reload/restart the net-snmpd log.   
   
    Please refer to the knowledge base articles to rotate/reload the net-snmpd.log   
   
    VPLEX: /var/log/ filling up due to net-snmpd.log not rotating properly   
   
    Check disk space to ensure the change is reflected.   
   
    ManagementServer:/var/log # df -h     
      Filesystem      Size  Used Avail Use% Mounted on     
      /dev/sda5        20G  7.3G   11G  41% /     
      udev            1.9G  136K  1.9G   1% /dev     
      tmpfs           1.9G   68M  1.8G   4% /dev/shm     
      /dev/sda1       504M  111M  368M  24% /boot     
      /dev/sda7        16G  2.4G   13G  16% /var/log     
      /dev/sda8        44G   27G   16G  64% /diag     
      /dev/sda9       9.9G  260M  9.1G   3% /data
   
   
    3) If after following the actions in KBA the issue still persists please contact Dell EMC Customer Service and mention this article.