aspose file tools*
The moose likes Servlets and the fly likes URL processing Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login
JavaRanch » Java Forums » Java » Servlets
Bookmark "URL processing" Watch "URL processing" New topic
Author

URL processing

Sunder Ganapathy
Ranch Hand

Joined: Apr 01, 2003
Posts: 120
An http page ( say A ) contains many links .
Is it possible to take one link after another
in A, and do processing as follows.
Get the next link in A . Let us say it is B.
If B is having many links, can we open each
link in B and write them to a separate file.

A bird's eye view would be very much helpful.
Ben Souther
Sheriff

Joined: Dec 11, 2004
Posts: 13410

The program 'wget' will spider through all of the links on a page and download each.
It's the program that is used to for mirror sites to update themselves.
I've never seen a Java version of it.
You might want to take a look at http://jakarta.apache.org/commons/httpclient.


Java API J2EE API Servlet Spec JSP Spec How to ask a question... Simple Servlet Examples jsonf
 
 
subject: URL processing