There are more than 8 DTs failed or DT stats check failed in last 3 rounds of DT status check.

Environment:

ECS Appliance

ECS Appliance Hardware

ECS Appliance Software 2.0

ECS Appliance Software 2.0 HF1

ECS Appliance Software 2.0 HF2

ECS Appliance Software 2.0 HF3

ECS Appliance Software 2.0 SP1 HF1

ECS Appliance Software 2.0 SP1 HF2

ECS Appliance Software 2.0 SP1 HF3

 

Description:

When Directory Tables (DT's) are in an unready state the application may have issues writing to the ECS Appliance.During the last three DT check there were more than 8 unready DT's in each check.Here is an example of the alert that the generated:

 

Connect Home

 

Clarify Id: 2AD2AD2AD2AD2A

Vendor: EMC

DeviceType: ElasticCloudStorageSW

Model: ViPR_Unstructured

SerialNumber: 2AD2AD2AD2AD2A

WWN: U

OS: ECS OS

OS_VER: vipr-2.0.1.0.62267.db4d4a8

EmbedLevel: 1

InternalMaxSize: 0

Ucode_Ver: Unknown

ConnectType: ESRS

IP_Address: 192.168.20.14

State: NA

AppName: ViPR

Port: 22

 

SymptomCode: 3001

Category: Unknown

Severity: HIGH

Status: Unknown

CallHome: true

Description: Customer Generated Alert Event: There are more than 8 DTs failed or DT stats check failed in last 3 rounds of DT status check.


 

Resolution:

Connect to the cluster using your favorite SSH client and run this command. As the DT check is a global command, do not run this command as a viprexec or domulti.

 

# curl http://localhost:9101/stats/dt/DTInitStat | grep unready_dt_num

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   188  100   188    0     0      6      0  0:00:31  0:00:27  0:00:04    42
<?xml version="1.0" encoding="UTF-8" standalone="yes"?><result><entry><total_dt_num>1920</total_dt_num><unready_dt_num>0</unready_dt_num><unknown_dt_num>0</unknown_dt_num></entry></result>

 

For a detailed step by step resolution please refer to EMC Support Solution 466848 https://support.emc.com/kb/466848