File APIs for Java Developers
Manipulate DOC, XLS, PPT, PDF and many others from your application.
The moose likes Servlets and the fly likes URL processing Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login
JavaRanch » Java Forums » Java » Servlets
Bookmark "URL processing" Watch "URL processing" New topic

URL processing

Sunder Ganapathy
Ranch Hand

Joined: Apr 01, 2003
Posts: 120
An http page ( say A ) contains many links .
Is it possible to take one link after another
in A, and do processing as follows.
Get the next link in A . Let us say it is B.
If B is having many links, can we open each
link in B and write them to a separate file.

A bird's eye view would be very much helpful.
Ben Souther

Joined: Dec 11, 2004
Posts: 13410

The program 'wget' will spider through all of the links on a page and download each.
It's the program that is used to for mirror sites to update themselves.
I've never seen a Java version of it.
You might want to take a look at

Java API J2EE API Servlet Spec JSP Spec How to ask a question... Simple Servlet Examples jsonf
I agree. Here's the link:
subject: URL processing
It's not a secret anymore!