Well, if you are under Windows, Add/Remove Applications located in the Control Panel should suffice.
If you are experimenting problems with this maybe
you should reinstall JDK 1.5 and then uninstall it. Maybe you should uninstall both JDKs and start it all over, just to make sure you did it right.