This week's book giveaway is in the OCMJEA forum. We're giving away four copies of OCM Java EE 6 Enterprise Architect Exam Guide and have Paul Allen & Joseph Bambara on-line! See this thread for details.
It has been ages since I did anything with WLS so I won't comment there.
But with JBoss AS, the sane way is to edit the xml configuration files directly. With most changes, a restart is required. There is also an admin console but not all changes made through it are persistent (you lose them on the next restart).
Actually, I answered the question regarding configuration, not administration (which includes configuration but also encompasses monitoring and other activities). For that Jopr is good. And then there is the JBoss Operations Network (JON) for EAP (the enterprise version of JBoss AS).