Win a copy of Think Java: How to Think Like a Computer Scientist this week in the Java in General forum!
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

collecting information from a website remotely

 
Atlas Cot
Greenhorn
Posts: 5
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
hello,

I'm trying to access a pulic website (e.g. ebay, amazon, etc.) using java to collect information. The program would simulate what a human would do like download a file or a click a link.
How would i go about doing this?
Any information would be greatly appreciated.


thanks in adv,
atlas
 
Michael Ernest
High Plains Drifter
Sheriff
Posts: 7292
Netbeans IDE VI Editor
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Why not use an existing tool like wget?
 
Ulf Dittmer
Rancher
Posts: 42967
73
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
I would use HttpUnit (on SourceForge) for this kind of automation. It was meant to be used for testing web pages, but can be used easily for simulating all kinds of web traffic, including form submission and the like.
 
Atlas Cot
Greenhorn
Posts: 5
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
thank you both for your inputs.

Would httpclient by apache do the similar work?
 
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic