File APIs for Java Developers
Manipulate DOC, XLS, PPT, PDF and many others from your application.
The moose likes Java in General and the fly likes Download Web Site's Source Code Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login
JavaRanch » Java Forums » Java » Java in General
Bookmark "Download Web Site Watch "Download Web Site New topic

Download Web Site's Source Code

Timothy Willard

Joined: Apr 03, 2001
Posts: 25
I would like to create a program to hit a web site's address, read the source code, and then write the source code to a local file. I am familiar with the package. Can someone point me in the right direction as to which classes I should be looking at for downloading souce from a web address. I created a smiliar program in VBScript and I used the Internet Transfer Control.
Jessica Sant

Joined: Oct 17, 2001
Posts: 4313

Check out this thread -- it might help you out: How to convert JSP into a txt or html file?
Stu Glassman
Ranch Hand

Joined: Jul 01, 2002
Posts: 91
I'm not sure if it's possible to do throught HTTP. The server will just process the file and send you the generated html stream. Can you get FTP access to the site?
andreas krohn

Joined: Nov 19, 2000
Posts: 18
Havent looked at this in detail but maybe Web SPHINX can help you ( It is a java open-source webcrawler.
I agree. Here's the link:
subject: Download Web Site's Source Code
It's not a secret anymore!