OpenSSO 8 OpenDS Replication - Error When Primary Server Down

[Steven Ercolani]

I'm currently having a problem with OpenSSO 8 (I know it's an old version) with replication of the OpenDS data. I have a situation where we have a master installation of OpenSSO and a secondary installation that replicate the data between them. The problem that I'm having is that if the primary server goes down, our application can no longer create users via the web service call. Also, the OpenSSO admin console displays an error page on the secondary server when trying to view the list of subjects. Once the primary server is back online, everything works fine again.

In the OpenSSO log, I see the error:

LDAPv3Repo:07/08/2011 09:03:46:493 AM EDT: Thread[ajp-secondary.domain.com%2F10.85.168.134-8009-2,5,jboss]
LDAPv3Repo.create failed
com.sun.identity.shared.ldap.LDAPException: Failed to connect to server primary.domain.com:50389 primary.domain.com:50389 (91)
at com.sun.identity.shared.ldap.LDAPConnSetupMgr.openConnection(LDAPConnSetupMgr.java:250)
at com.sun.identity.shared.ldap.LDAPConnThread.connect(LDAPConnThread.java:111)
at com.sun.identity.shared.ldap.LDAPConnection.connect(LDAPConnection.java:1087)
at com.sun.identity.shared.ldap.LDAPConnection.restoreConnection(LDAPConnection.java:1866)
at com.sun.identity.shared.ldap.LDAPConnection.checkConnection(LDAPConnection.java:1859)
at com.sun.identity.shared.ldap.LDAPConnection.add(LDAPConnection.java:2863)
at com.sun.identity.shared.ldap.LDAPConnection.add(LDAPConnection.java:2892)
at com.sun.identity.shared.ldap.LDAPConnection.add(LDAPConnection.java:2842)
at com.sun.identity.idm.plugins.ldapv3.LDAPv3Repo.create(LDAPv3Repo.java:1983)
at com.sun.identity.idm.server.IdServicesImpl.create(IdServicesImpl.java:433)
at com.sun.identity.idm.AMIdentityRepository.createIdentity(AMIdentityRepository.java:382)
at com.sun.identity.idsvcs.opensso.IdentityServicesImpl.create(IdentityServicesImpl.java:697)
at com.sun.identity.idsvcs.IdentityServicesImpl_Tie.invoke_create(IdentityServicesImpl_Tie.java:778)
at com.sun.identity.idsvcs.IdentityServicesImpl_Tie.processingHook(IdentityServicesImpl_Tie.java:1143)
at com.sun.xml.rpc.server.StreamingHandler.handle(StreamingHandler.java:350)
at com.sun.xml.rpc.server.http.JAXRPCServletDelegate.doPost(JAXRPCServletDelegate.java:465)
at com.sun.xml.rpc.server.http.JAXRPCServlet.doPost(JAXRPCServlet.java:119)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.sun.identity.setup.AMSetupFilter.doFilter(AMSetupFilter.java:91)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:235)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:190)
at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:92)
at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.process(SecurityContextEstablishmentValve.java:126)
at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.invoke(SecurityContextEstablishmentValve.java:70)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:158)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:330)
at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:436)
at org.apache.coyote.ajp.AjpProtocol$AjpConnectionHandler.process(AjpProtocol.java:384)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
at java.lang.Thread.run(Thread.java:619)

I'm wondering if this could be a configuration problem, if this is a bug in OpenSSO 8 or if this is expected behaviour with OpenDS replication.