Data Protection Advisor - Report began running slowly and now takes 22-23 hours

           

   Article Number:     528701                                   Article Version: 3     Article Type:    Break Fix 
   

 


Product:

 

Data Protection Advisor 6.5

 

Issue:

 

 

This custom report started taking a much longer time to run than it had before. It used to complete in few minutes and now takes 22-23 hours scoped to a parent group of 20 backup servers. As per customer nothing has changed in the configuration of the report.   
        
    Troubleshooting path consisted of:    

         
  1.         Timing the report scoped to lesser number of nodes in order to narrow down the issue.     
  2.      
  3.         Gathering the report debug logs using both single node scope and parent group scope to examine the queries that take most of the time.     
  4.      
  5.         The .wds export of the report     
  6.    
    The report completed in couple of minutes when scoped to either the 20 individually selected nodes or to any single node but when scoped to the entire parent group it took a very long time.   
                                                                

 

 

Cause:

 

 

It was identified that for some reason PostgreSQL database is using a poor query plan for the backupjob table on the 20-node parent group.   
     
                                                           

 

 

Resolution:

 

 

Workaround was running the report on the 20 individually selected child nodes   
        
    More investigation is needed to determine why the entire 20-node group query started performing poor suddenly. It has occurred twice in few months.   
        
     Contact Dell EMC Data Protection Advisor support team for further information