File APIs for Java Developers
Manipulate DOC, XLS, PPT, PDF and many others from your application.
http://aspose.com/file-tools
The moose likes Java in General and the fly likes collecting information from a website remotely Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login
JavaRanch » Java Forums » Java » Java in General
Bookmark "collecting information from a website remotely" Watch "collecting information from a website remotely" New topic
Author

collecting information from a website remotely

Atlas Cot
Greenhorn

Joined: Sep 12, 2005
Posts: 5
hello,

I'm trying to access a pulic website (e.g. ebay, amazon, etc.) using java to collect information. The program would simulate what a human would do like download a file or a click a link.
How would i go about doing this?
Any information would be greatly appreciated.


thanks in adv,
atlas
Michael Ernest
High Plains Drifter
Sheriff

Joined: Oct 25, 2000
Posts: 7292

Why not use an existing tool like wget?


Make visible what, without you, might perhaps never have been seen.
- Robert Bresson
Ulf Dittmer
Marshal

Joined: Mar 22, 2005
Posts: 41508
    
  53
I would use HttpUnit (on SourceForge) for this kind of automation. It was meant to be used for testing web pages, but can be used easily for simulating all kinds of web traffic, including form submission and the like.


Ping & DNS - my free Android networking tools app
Atlas Cot
Greenhorn

Joined: Sep 12, 2005
Posts: 5
thank you both for your inputs.

Would httpclient by apache do the similar work?
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: collecting information from a website remotely