Start a Conversation

Solved!

Go to Solution

4298

November 28th, 2018 11:00

Failed to create RecoverPoint consistency group

Hello

We are getting an error when using Vipr 3.6 and RPA 5 to create a volume.


Error 19000: Message: Failed to create RecoverPoint consistency group ViPR-DAL-HAW: Links for RecoverPoint consistency group: ViPR-DAL-HAW failed to become active

Description: Create consistency group subtask for RP CG: ViPR-DAL-HAW

Additional errors occurred during processing.  Each error is listed below.

Additional Message: Failed to delete consistency group ViPR-DAL-HAW: Illegal consistency group parameter: ConsistencyGroupUID [id=23378130]

Description: Rollback Create consistency group subtask for RP CG: ViPR-DAL-HAW

Additional Message: "Error deleting volumes: Failed to delete volumes: DAL-HAW-PWHAWXIO-journal-1:-Internal Error : {"message":"cannot_remove_volume_that_is_mapped","error_code":400}"

Rollback encountered problems cleaning up XTREMIO+FNM00161200193+VOLUME+a3b4be2786824eb69dd5a4e527803650 and may require manual clean up

Description: Rollback Creating volumes:

Volume: DAL-HAW-PWHAWXIO-journal-1 (urn:storageos:Volume:315f4746-7279-4766-9981-d8d1c35e8943:vdc1)

Additional Message: "Error deleting volumes: Failed to delete volumes: PWDA-GRID-REP-01-target-PWHAWXIO_829:-Internal Error : {"message":"cannot_remove_volume_that_is_mapped","error_code":400}"

Rollback encountered problems cleaning up XTREMIO+FNM00161200193+VOLUME+a99f1f11e3b649a1a341919915d2dd4d and may require manual clean up

Description: Rollback Creating volumes:

Volume: PWDA-GRID-REP-01-target-PWHAWXIO (urn:storageos:Volume:7109cd52-fd11-49b7-b445-2a55d1387cc7:vdc1)

Logs

Date Level Message
Nov 28th 2018, 11:23:13 AM INFO Logged into vCenter 'DAVDIVMVC01.noco.corp' VMware vCenter Server 6.0.0 build-3018523
Nov 28th 2018, 11:23:13 AM INFO Targeting Cluster 'Grid_Users' containing 8 hosts
Nov 28th 2018, 11:23:14 AM INFO Host 'pwdavdiesxp01.noco.corp' connection state: connected
Nov 28th 2018, 11:50:41 AM ERROR Error 19000: Message: Failed to create RecoverPoint consistency group ViPR-DAL-HAW: Links for RecoverPoint consistency group: ViPR-DAL-HAW failed to become active Description: Create consistency group subtask for RP CG: ViPR-DAL-HAW Additional errors occurred during processing. Each error is listed below. Additional Message: Failed to delete consistency group ViPR-DAL-HAW: Illegal consistency group parameter: ConsistencyGroupUID [id=23378130] Description: Rollback Create consistency group subtask for RP CG: ViPR-DAL-HAW Additional Message: "Error deleting volumes: Failed to delete volumes: DAL-HAW-PWHAWXIO-journal-1:-Internal Error : {"message":"cannot_remove_volume_that_is_mapped","error_code":400}" Rollback encountered problems cleaning up XTREMIO+FNM00161200193+VOLUME+a3b4be2786824eb69dd5a4e527803650 and may require manual clean up Description: Rollback Creating volumes: Volume: DAL-HAW-PWHAWXIO-journal-1 (urn:storageos:Volume:315f4746-7279-4766-9981-d8d1c35e8943:vdc1) Additional Message: "Error deleting volumes: Failed to delete volumes: PWDA-GRID-REP-01-target-PWHAWXIO_829:-Internal Error : {"message":"cannot_remove_volume_that_is_mapped","error_code":400}" Rollback encountered problems cleaning up XTREMIO+FNM00161200193+VOLUME+a99f1f11e3b649a1a341919915d2dd4d and may require manual clean up Description: Rollback Creating volumes: Volume: PWDA-GRID-REP-01-target-PWHAWXIO (urn:storageos:Volume:7109cd52-fd11-49b7-b445-2a55d1387cc7:vdc1)
com.emc.vipr.client.exceptions.ServiceErrorException: Error 19000: Message: Failed to create RecoverPoint consistency group ViPR-DAL-HAW: Links for RecoverPoint consistency group: ViPR-DAL-HAW failed to become active Description: Create consistency group subtask for RP CG: ViPR-DAL-HAW Additional errors occurred during processing. Each error is listed below. Additional Message: Failed to delete consistency group ViPR-DAL-HAW: Illegal consistency group parameter: ConsistencyGroupUID [id=23378130] Description: Rollback Create consistency group subtask for RP CG: ViPR-DAL-HAW Additional Message: "Error deleting volumes: Failed to delete volumes: DAL-HAW-PWHAWXIO-journal-1:-Internal Error : {"message":"cannot_remove_volume_that_is_mapped","error_code":400}" Rollback encountered problems cleaning up XTREMIO+FNM00161200193+VOLUME+a3b4be2786824eb69dd5a4e527803650 and may require manual clean up Description: Rollback Creating volumes: Volume: DAL-HAW-PWHAWXIO-journal-1 (urn:storageos:Volume:315f4746-7279-4766-9981-d8d1c35e8943:vdc1) Additional Message: "Error deleting volumes: Failed to delete volumes: PWDA-GRID-REP-01-target-PWHAWXIO_829:-Internal Error : {"message":"cannot_remove_volume_that_is_mapped","error_code":400}" Rollback encountered problems cleaning up XTREMIO+FNM00161200193+VOLUME+a99f1f11e3b649a1a341919915d2dd4d and may require manual clean up Description: Rollback Creating volumes: Volume: PWDA-GRID-REP-01-target-PWHAWXIO (urn:storageos:Volume:7109cd52-fd11-49b7-b445-2a55d1387cc7:vdc1) at com.emc.vipr.client.core.impl.TaskUtil.checkForErrors(TaskUtil.java:101) at com.emc.vipr.client.Tasks.waitFor(Tasks.java:129) at com.emc.sa.service.vipr.tasks.LongRunningTasks.executeTask(LongRunningTasks.java:47) at com.emc.sa.service.vipr.tasks.LongRunningTasks.executeTask(LongRunningTasks.java:11) at com.emc.sa.engine.ExecutionUtils.execute(ExecutionUtils.java:92) at com.emc.sa.engine.ExecutionUtils.execute(ExecutionUtils.java:83) at com.emc.sa.service.vipr.ViPRExecutionUtils.execute(ViPRExecutionUtils.java:41) at com.emc.sa.service.vipr.block.BlockStorageUtils.createMultipleVolumes(BlockStorageUtils.java:459) at com.emc.sa.service.vmware.block.CreateVolumeAndVmfsDatastoreService.execute(CreateVolumeAndVmfsDatastoreService.java:112) at com.emc.sa.engine.ExecutionEngineImpl.execute(ExecutionEngineImpl.java:191) at com.emc.sa.engine.ExecutionEngineImpl.runService(ExecutionEngineImpl.java:129) at com.emc.sa.engine.ExecutionEngineImpl.executeOrder(ExecutionEngineImpl.java:72) at com.emc.sa.engine.ExecutionEngineDispatcher.processOrder(ExecutionEngineDispatcher.java:50) at com.emc.sa.engine.ExecutionEngineDispatcher$Consumer.consumeItem(ExecutionEngineDispatcher.java:91) at com.emc.sa.engine.ExecutionEngineDispatcher$Consumer.consumeItem(ExecutionEngineDispatcher.java:85) at com.emc.storageos.coordinator.client.service.impl.DistributedQueueConsumer$1.run(DistributedQueueConsumer.java:80) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

November 29th, 2018 08:00

fixed the issue by shorting the names

November 29th, 2018 08:00

What is the full version number of Vipr-C and RP are you using?

From the Vipr-C support matrix, Vipr-C 3.6.0.x thru 3.6.1.x does NOT support any RP version above 4.4.1.x.

For RP 5.0 SP1 P3 HF5, 5.1, and 5.1 SP2 P1, you would need Vipr-C 3.6.2.x

Your initial issue is:

     Error 19000: Message: Failed to create RecoverPoint consistency group ViPR-DAL-HAW: Links for RecoverPoint consistency group: ViPR-DAL-HAW failed to become active


All the rest seem to be issues during rollback.


I did a quick search the above error, and there were a couple of instances where the customer had to re-run the job a few times for it to complete. (Possibly an issue on the RP side of things for 1 issue, a vplex issue for another)


If you have a supported config (the right versions of RP and Vipr-C), and re-running the order does not work, then you should open a Service Request and supply:

Vipr-C logs from the time of the error

Slither or diagutils output

The failed order number



No Events found!

Top