VBA: Unable to connect to VBA with error NW_7047

           

   Article Number:     484281                                   Article Version: 2     Article Type:    Break Fix 
   

 


Product:

 

NetWorker 8.2.1,NetWorker 8.2.2,NetWorker 8.2.3,NetWorker 8.2

 

Issue:

 

 

The NetWorker VMware Protection integration is configured with the Virtual Backup Appliance (VBA).  The NetWorker Management Console (NMC) shows the policy executions fail indicating it is unable to connect to the VBA.  The NMC Configuration tab shows the VBA is an error state under the VMware Backup Appliances tree view.    
        

      User-added image     
          
    The VMware Protection Policy log in the "[INSTALL_DIR]\nsr\log\policy\[POLICY_NAME]" directory shows:   
      112625:nsrvba_save: There was an error related to VBA "myvba.mydomain.com", service "session/connect".       
        106658:nsrvba_save: VBA returned status of FAILURE: details "NW_7047:An exception occurred while trying to connect.       
        org.apache.http.auth.AuthenticationException: Authentication with mcs was unsuccessfull.       
         at com.emc.networker2.business.NwConnectBusiness.sessionConnect(NwConnectBusiness.java:44)       
         at com.emc.networker2.rest.NwConnectService.sessionConnect(NwConnectService.java:69)       
         at sun.reflect.GeneratedMethodAccessor372.invoke(Unknown Source)       
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)       
         at java.lang.reflect.Method.invoke(Unknown Source)       
         at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)       
         at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)       
         at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)       
         at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)       
         at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)       
         at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)       
         at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)       
         at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)       
         at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)       
         at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)       
         at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)       
         at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)       
         at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)       
         at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:540)       
         at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:715)       
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)       
         at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)       
         at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)       
         at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)       
         at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)       
         at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)       
         at com.emc.vdp2.services.AuthenticationFilter.doFilter(AuthenticationFilter.java:117)       
         at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)       
         at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)       
         at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)       
         at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)       
         at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:610)       
         at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)       
         at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)       
         at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)       
         at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)       
         at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1040)       
         at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:607)       
         at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1720)       
         at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1679)       
         at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)       
         at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)       
         at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)       
         at java.lang.Thread.run(Unknown Source)".       
        106011:nsrvba_save: Unable to connect to VBA myvba.mydomain.com, error VBA returned status of FAILURE: details "NW_7047:An exception occurred while trying to connect.       
        org.apache.http.auth.AuthenticationException: Authentication with mcs was unsuccessfull.       
         at com.emc.networker2.business.NwConnectBusiness.sessionConnect(NwConnectBusiness.java:44)       
         at com.emc.networker2.rest.NwConnectService.sessionConnect(NwConnectService.java:69)       
         at sun.reflect.GeneratedMethodAccessor372.invoke(Unknown Source)       
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)       
         at java.lang.reflect.Method.invoke(Unknown Source)       
         at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)       
         at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)       
         at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)       
         at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)       
         at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)       
         at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)       
         at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)       
         at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)       
         at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)       
         at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)       
         at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)       
         at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)       
         at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)       
         at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:540)       
         at com.sun.jersey.spi.container.servlet.ServletContainer.servic".
   
   
   
    The VBA ebr-server.log shows:   
      YYY/MM/DD-HH:MM:SSINFO  [http-nio-8543-exec-2]-rest.NwConnectService: Attempting connection in NwConnectService       
        YYY/MM/DD-HH:MM:SSERROR [http-nio-8543-exec-2]-service.AdapterUtils: ServiceInstance failed to authenticate mc credentials for MCUser fault-event-desc=User login failure. fault-event-name=E22801 fault-event-value=22801       
        com.avamar.mc.sdk10.McsFaultMsgException: McsFaultMsgException       
         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)       
         at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)       
         at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)       
         at java.lang.reflect.Constructor.newInstance(Unknown Source)       
         at java.lang.Class.newInstance(Unknown Source)       
         at com.avamar.mc.sdk10.Mcsdk10Stub.login(Mcsdk10Stub.java:55188)       
         at com.emc.avamar.mcsdk.adapter.service.ServiceInstance.doLogin(ServiceInstance.java:578)       
         at com.emc.networker2.business.NwConnectBusiness.sessionConnect(NwConnectBusiness.java:37)       
         at com.emc.networker2.rest.NwConnectService.sessionConnect(NwConnectService.java:69)       
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)       
         at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)       
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)       
         at java.lang.reflect.Method.invoke(Unknown Source)       
         at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)       
         at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)       
         at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)       
         at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)       
         at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)       
         at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)       
         at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)       
         at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)       
         at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)       
         at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)       
         at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)       
         at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)       
         at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)       
         at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:540)       
         at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:715)       
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)       
         at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)       
         at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)       
         at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)       
         at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)       
         at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)       
         at com.emc.vdp2.services.AuthenticationFilter.doFilter(AuthenticationFilter.java:117)       
         at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)       
         at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)       
         at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)       
         at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)       
         at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:610)       
         at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)       
         at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)       
         at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950)       
         at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)       
         at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)       
         at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1040)       
         at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:607)       
         at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1720)       
         at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1679)       
         at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)       
         at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)       
         at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)       
         at java.lang.Thread.run(Unknown Source)       
        YYY/MM/DD-HH:MM:SS ERROR [http-nio-8543-exec-2]-rest.NwConnectService: MCS Authentication failed
     
          
   
      The VBA mcserver.log shows:   
   
      MM/DD-HH:MM:SS com.avamar.mc.util.MCException.logException       
        WARNING: javax.security.auth.login.LoginException:       
        Login Failed!       
        Result: 0  ERROR!  Exit code 69: Authentication failure  (Invalid password?  User disabled?)       
        YYY/MM/DD-HH:MM:SS [avmgr]  ERROR: <0001> uplinkcallbase::send   Could not send message to dispatcher       
          at com.avamar.mc.security.AvmgrLoginModule.login(AvmgrLoginModule.java:141)       
          at sun.reflect.GeneratedMethodAccessor42.invoke(Unknown Source)       
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)       
          at java.lang.reflect.Method.invoke(Unknown Source)       
          at javax.security.auth.login.LoginContext.invoke(Unknown Source)       
          at javax.security.auth.login.LoginContext.access$000(Unknown Source)       
          at javax.security.auth.login.LoginContext$4.run(Unknown Source)       
          at javax.security.auth.login.LoginContext$4.run(Unknown Source)       
          at java.security.AccessController.doPrivileged(Native Method)       
          at javax.security.auth.login.LoginContext.invokePriv(Unknown Source)       
          at javax.security.auth.login.LoginContext.login(Unknown Source)       
          at com.avamar.mc.security.AvmgrSecurityModule.authenticateLoginPrincipal(AvmgrSecurityModule.java:79)       
          at com.avamar.mc.security.DefaultSecurityModule.authenticate(DefaultSecurityModule.java:38)       
          at com.avamar.mc.sdk10.mo.ServiceMO.authenticate(ServiceMO.java:121)       
          at com.avamar.mc.sdk10.mo.ServiceMO.login(ServiceMO.java:85)       
          at com.avamar.mc.sdk10.Mcsdk10Skeleton.login(Mcsdk10Skeleton.java:112)       
          at com.avamar.mc.sdk10.Mcsdk10MessageReceiverInOut.invokeBusinessLogic(Mcsdk10MessageReceiverInOut.java:11082)       
          at org.apache.axis2.receivers.AbstractInOutMessageReceiver.invokeBusinessLogic(AbstractInOutMessageReceiver.java:40)       
          at org.apache.axis2.receivers.AbstractMessageReceiver.receive(AbstractMessageReceiver.java:114)       
          at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:173)       
          at org.apache.axis2.transport.http.HTTPTransportUtils.processHTTPPostRequest(HTTPTransportUtils.java:173)       
          at org.apache.axis2.transport.http.AxisServlet.doPost(AxisServlet.java:144)       
          at javax.servlet.http.HttpServlet.service(HttpServlet.java:641)       
          at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)       
          at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)       
          at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:390)       
          at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)       
          at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)       
          at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)       
          at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418)       
          at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)       
          at org.mortbay.jetty.Server.handle(Server.java:326)       
          at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)       
          at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:939)       
          at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:843)       
          at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)       
          at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)       
          at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)       
          at org.mortbay.jetty.security.SslSocketConnector$SslConnection.run(SslSocketConnector.java:680)       
          at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
   
   
                                                                

 

 

Cause:

 

 

The change EBR password update request did not update the "REST Services Password" value in the NetWorker Server database (nsrdb).  The root cause of the change EBR password update failure is not known at this time.                                                           

 

 

Change:

 

 

The "Change EBR password" option, under the "Configuration" tab, in the EMC Backup and Recovery Configuration Utility (ebr-configure) web page was used to update the password.                                                           

 

 

Resolution:

 

 

Workaround:    
    Manually update the  "REST Services Password" in the NMC and restart the NetWorker Server services.   

         
  •         Open the NMC and select the Configuration tab.     
  •      
  •         Put the NMC in Diagnostic Mode: Ctrl+ALT+D     
  •      
  •         In the left had tree-view, select "VMware Backup Appliances".     
  •      
  •         In the right had pane, select the VBA experiencing the symptom and access the properties: Ctrl+O     
  •      
  •         Update the "REST Services Password" value with the new password.     
  •      
  •         Restart the NetWorker Backup and Recover Server (nsrd) process on the NetWorker Server.     
  •