SSLHandshakeException

[Santh Narayanan]

I am trying to test an example using RMI over SSL.

The example doesn't give me an error when I use LocateRegistry.createRegistry(<port> to start a registry in the application.
When I comment out the LocateRegistry and use the command line rmiregistry <port> I get this error when it tries to do Naming.bind(name, server);.

Error:
Exception in thread "main" java.rmi.ConnectIOException: error during JRMP connection establishment;
nested exception is:
        javax.net.ssl.SSLHandshakeException: Remote host closed connection during handshake
        at sun.rmi.transport.tcp.TCPChannel.createConnection(Unknown Source)
        at sun.rmi.transport.tcp.TCPChannel.newConnection(Unknown Source)
        at sun.rmi.server.UnicastRef.newCall(Unknown Source)
        at sun.rmi.registry.RegistryImpl_Stub.bind(Unknown Source)
        at java.rmi.Naming.bind(Unknown Source)
        at SecurityRMIServer.main(SecurityRMIServer.java:30)
Caused by: javax.net.ssl.SSLHandshakeException: Remote host closed connection during handshake
        at com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(Unknown Source)
        at com.sun.net.ssl.internal.ssl.SSLSocketImpl.performInitialHandshake(Unknown Source)
        at com.sun.net.ssl.internal.ssl.SSLSocketImpl.writeRecord(Unknown Source)
        at com.sun.net.ssl.internal.ssl.AppOutputStream.write(Unknown Source)
        at java.io.BufferedOutputStream.flushBuffer(Unknown Source)
        at java.io.BufferedOutputStream.flush(Unknown Source)
        at java.io.DataOutputStream.flush(Unknown Source)
        ... 6 more
Caused by: java.io.EOFException: SSL peer shut down incorrectly
        at com.sun.net.ssl.internal.ssl.InputRecord.read(Unknown Source)
        ... 13 more

    
Code:
import java.rmi.Naming;
import java.rmi.registry.Registry;
import java.rmi.registry.LocateRegistry;
 
public class SecurityRMIServer
{
 
    public SecurityRMIServer() {}
 
    /**
     */
    public static void main(String[] args) throws Exception
    {
        System.out.println("System time: " + new java.util.Date());
        System.setProperty("javax.net.ssl.trustStore", "C:\\RMISSL\\server.keystore");
        System.setProperty("javax.net.ssl.keyStore", "C:\\RMISSL\\server.keystore");
        System.setProperty("javax.net.ssl.keyStorePassword", "server");
        //
 
        System.out.println("Registering secure RMI socket factory ...");
        java.rmi.server.RMISocketFactory.setSocketFactory(new SecureRMISocketFactory(false));
 
[B]     //
        //Registry registry = LocateRegistry.createRegistry(9999);
        //
[/B]
        String name = "rmi://localhost:9999/Test";
        TestRemoteImpl server = new TestRemoteImpl();
        Naming.bind(name, server);
 
        System.out.println("Test object bound to " + name);
    }
}

Thanks.

[Nathan Pruett]

I think it's because you're setting the SecureRMISocketFactory as the RMISocketFactory - it's probably assuming that *all* socket communication is going to be using SSL. If you start the registry outside the server, it's not going to be using this SocketFactory, so when your server tries to register with the registry, it uses an SSL socket, but gets a "regular" socket response from the registry.

It's possible to use the "regular" registry, but still use a custom socket factory between your client and server - the Using a Custom Socket Factory guide on Sun's site shows how.

[Santh Narayanan]

That worked and also understood the concept.
I really appreciate your answer.

Thanks Nathan,

[Santh Narayanan]

I start my server with the following code, which works perfect,
it doesn't give an exception if I run the main method in this class.

If I try to run the client, i get the error.

one thing I have noted, the NotSerializableException does not
occur with the Registry.rebind invocation is that you invoke rebind on
a registry reference returned from LocateRegistry.createRegistry

I this situation I am using rmiregistry command.

    
public class StartServer
{
 
    public StartServer() {}
    public static void main(String[] args)
    {
        try
        {
            /** Create remote object and export it to use custom socket factories. */
            HelloImpl obj = new HelloImpl();
            RMISSLClientSocketFactory csf = new RMISSLClientSocketFactory();
            RMISSLServerSocketFactory ssf = new RMISSLServerSocketFactory();
            Hello stub = (Hello) UnicastRemoteObject.exportObject(obj, 0, csf, ssf);
 
            /** Create a registry and bind stub in registry. */
            String URL = "rmi://se413697:9999/HelloServer";
            Naming.rebind(URL, stub);
            System.out.println("HelloImpl bound in registry");
        }
        catch (Exception e)
        {
        }
    }
}

Error:

HelloClient exception: error unmarshalling return; nested exception is:
java.io.WriteAbortedException: writing aborted; java.io.NotSerializableException: com.sun.ne
t.ssl.internal.ssl.SSLSocketFactoryImpl
java.rmi.UnmarshalException: error unmarshalling return; nested exception is:
java.io.WriteAbortedException: writing aborted; java.io.NotSerializableException: com.sun.ne
t.ssl.internal.ssl.SSLSocketFactoryImpl
at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
at java.rmi.Naming.lookup(Unknown Source)
at HelloClient.main(HelloClient.java:16)
Caused by: java.io.WriteAbortedException: writing aborted; java.io.NotSerializableException: com.sun
.net.ssl.internal.ssl.SSLSocketFactoryImpl
at java.io.ObjectInputStream.readObject0(Unknown Source)
.......

I have listed all the remaining class.

public class HelloClient
{
    public static void main(String args[])
    {
        try
        {
            String URL = "rmi://se413697:9999/HelloServer";
            Hello obj = (Hello) Naming.lookup(URL);
            String message = obj.sayHello();
        }
        catch (Exception e)
        {
        }
    }
}
 
public class RMISSLClientSocketFactory implements RMIClientSocketFactory, Serializable
{
    private SSLSocketFactory socketFactory = null;
    public RMISSLClientSocketFactory() {}
    public Socket createSocket(String host, int port) throws IOException
    {
        socketFactory = (SSLSocketFactory) SSLSocketFactory.getDefault();
        SSLSocket socket = (SSLSocket) socketFactory.createSocket(host, port);
        return socket;
    }
    public int hashCode()
    {
        return getClass().hashCode();
    }
    public boolean equals(Object obj)
    {
        return getClass() == obj.getClass();
    }
}
 

public class RMISSLServerSocketFactory implements RMIServerSocketFactory
{
    private SSLServerSocketFactory serverSocketFactory = null;
    public RMISSLServerSocketFactory() throws Exception  { }
    public ServerSocket createServerSocket(int port) throws IOException
    {
        serverSocketFactory = (SSLServerSocketFactory) SSLServerSocketFactory.getDefault();
        return serverSocketFactory.createServerSocket(port);
    }
    public int hashCode()
    {
        return getClass().hashCode();
    }
    public boolean equals(Object obj)
    {
        return (getClass() == obj.getClass());
    }
}

Please let me know how can I fix this problem.
Thanks.

[Nathan Pruett]

It think the problem is that your SSLSocketFactory inside your RMISSLClientSocketFactory isn't serializable. You should mark that field as "transient" and restore the value inside a "readObject()" method.

For more information on how the transient keyword and readObject()/writeObject() works with Serializable objects - here's an article that covers it...