ViPR Controller: Vplex volume ingestion fails.

           

   Article Number:     532007                                   Article Version: 2     Article Type:    Break Fix 
   

 


Product:

 

ViPR Controller Controller 3.6,ViPR Controller Controller 3.6 SP1,ViPR Controller Controller 3.6 SP2

 

Issue:

 

 

Ingestion of the a VIPR volume fails with the following error :     
     
      ViPR Controller UI:
   
    Error 64000: Unmanaged Volume Ingestion Exception. None of the export masks of the unmanaged volume XXXXXXXXXX00-XXXX-00 have been ingested, so the volume cannot be ingested.   
   
    apisvc log :   
   
    Export Mask Ingestion failed for UnManaged block object : /clusters/cluster-1/virtual-volumes/XXXXXXXX00-XXXX-00     
       com.emc.storageos.db.exceptions.RetryableDatabaseException: Database connection failed. Please check the database services and network connectivity on all nodes     
      .......
   
    Caused by: com.netflix.astyanax.connectionpool.exceptions.TransportException: TransportException: [host=00.000.000.000(00.000.000.000):9160, latency=691(12512), attempts=5]org.apache.thrift.transport.TTransportException: Frame size (16897732) larger than max length (16384000)!
                                                           

 

 

Cause:

 

 

This issue is caused by a large database query.   
    The data packet size sent to the Cassandra server in a dbclient request exceeded the limit (15 MB).
                                                           

 

 

Change:

 

 

The ViPR Controller database size is a contributing factor with regard to this issue.   
    In a very large database, this issue may occur in any catalog order if data packet limit is exceeded by a query.
                                                           

 

 

Resolution:

 

 

Workaround :   
   
    On each ViPR Controller node, perform the following action :   
   
    1. Use a text editor to modify the file /opt/storageos/conf/db-conf.yaml   
    2. Change the parameter thrift_framed_transport_size_n_mb  from 15 to 50   
    3. Restart the dbsvc service on the VIPR Controller node.   
    4. Repeat steps 1 -3 on each VIPR Controller node.   
   
   
    Resolution :   
   
    DellEMC is evaluating the requirements to address this issue in upcoming ViPR Controller product releases.   
    For the latest information on this issue, contact DellEMC Customer Service (CS) and reference this DellEMC article number.   
     
                                                           

 

 

Notes:

 

 

apisvc log :   
   
    vipr1 hostname apisvc 2019-03-27 11:46:50,486 [AsyncTaskExecutorService_310] ERROR BlockIngestExportOrchestrator.java (line 446) Export Mask Ingestion failed for UnManaged block object : /clusters/cluster-1/virtual-volumes/XXXXXXXX00-XXXX-00     
       com.emc.storageos.db.exceptions.RetryableDatabaseException: Database connection failed. Please check the database services and network connectivity on all nodes     
       at com.emc.storageos.db.client.impl.DbClientImpl.queryRowsWithAllColumns(DbClientImpl.java:1585)     
       at com.emc.storageos.db.client.impl.DbClientImpl.queryObject(DbClientImpl.java:445)     
       at com.emc.storageos.db.client.impl.DbClientImpl.queryObject(DbClientImpl.java:427)     
       at com.emc.storageos.api.service.impl.resource.utils.VolumeIngestionUtil.validateUnManagedExportMasks(VolumeIngestionUtil.java:5002)     
       at
   
     com.emc.storageos.api.service.impl.resource.blockingestorchestration.BlockIngestExportOrchestrator.ingestExportMasks(BlockIngestExportOrchestrator.java:88)     
       at com.emc.storageos.api.service.impl.resource.blockingestorchestration.MultipleMaskPerHostIngestOrchestrator.ingestExportMasks(MultipleMaskPerHostIngestOrchestrator.java:41)     
       at com.emc.storageos.api.service.impl.resource.blockingestorchestration.IngestExportStrategy.ingestExportMasks(IngestExportStrategy.java:63)     
       at com.emc.storageos.api.service.impl.resource.blockingestorchestration.IngestVolumesExportedSchedulingThread.ingestBlockExportMasks(IngestVolumesExportedSchedulingThread.java:243)     
       at
   
     com.emc.storageos.api.service.impl.resource.blockingestorchestration.IngestVolumesExportedSchedulingThread.run(IngestVolumesExportedSchedulingThread.java:135)     
       at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)     
       at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)     
       at java.lang.Thread.run(Thread.java:748)     
       Caused by: com.netflix.astyanax.connectionpool.exceptions.TransportException: TransportException: [host=00.000.000.000(00.000.000.000):9160, latency=691(12512), attempts=5]org.apache.thrift.transport.TTransportException: Frame size (16897732) larger than max length (16384000)!