public class HelloHTML extends javax.servlet.http.HttpServlet
public void doGet(javax.servlet.http.HttpServletRequest request, javax.servlet.http.HttpServletResponse response) throws
PrintWriter out = response.getWriter();
"<TITLE>Hello HTML Sample</TITLE>\n" +
"<H1>Hello HTML Sample</H1>\n" +
"</BODY>\n" + "</HTML>");
The Servlet API is not part of Standard Edition Java. And if you are just interested in Servlets and JSP rather than all the other myriad EE technologies, you can just download a servlet container such as Tomcat and it will provide the necessary jar files. That will be a lot less confusing than all of JEE.
If you want to get into EJBs or other EE technologies (probably not, at this point), then you'll need JEE.
For the Eclipse IDE, you need to install a server runtime, like Apache Tomcat (servlets & jsp only) or Glassfish (full JEE stack).
There is an old article on installing Tomcat in Eclipse, but the information is still relevant. Installing Glassfish (or Geronimo), can be done in a similar manner, if you need a full JEE stack. Tomcat should be enough to solve your immediate issue.
In preparing for battle I have always found that plans are useless, but planning is indispensable. -- Dwight D. Eisenhower