It's not a secret anymore!*
The moose likes Java in General and the fly likes Data mining a webpage Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login
JavaRanch » Java Forums » Java » Java in General
Bookmark "Data mining a webpage" Watch "Data mining a webpage" New topic
Author

Data mining a webpage

Gorby Green
Greenhorn

Joined: Nov 23, 2002
Posts: 12
Hi!
I want to create at data mining applikation that collects info from a dropdown list on a webpage. My purpose with this is to store that information into a single xml-file.
What is the best way to do this?

Does anyone know some good site or some good api?

My example:
I would like to store data from date and country- droplists from this html- site.

<html
<head>
<title>Testpage</title>
</head>
<body>
<form name="date" id="date" method="post" action="">
<select name="select">
<option value="20060101">01 Jan 06</option>
<option value="20060102">02 Jan 06</option>
<option value="20060103">03 Jan 06</option>
<option value="20060104">04 Jan 06</option>
</select>
</form>
<form name="country" id="country" method="country" action="">
<select name="select">
<option value="au">Australia</option>
<option value="dk">Denmark</option>
<option value="fi">Finland</option>
<option value="/fr/">France</option>
<option value="/de/">Germany</option>
</select>
</form>
</body>
</html>

/Gorby
Ulf Dittmer
Marshal

Joined: Mar 22, 2005
Posts: 39551
    
  27
For all these purposes I recommened HttpUnit (on SourceForge). It's meant to be a web testing extension to JUnit, but can very nicely be used for accessing web pages programmatically.


Ping & DNS - updated with new look and Ping home screen widget
Tom Blough
Ranch Hand

Joined: Jul 31, 2003
Posts: 263
Search the forums. This topic has been covered recently.

Cheers,


Tom Blough<br /> <blockquote><font size="1" face="Verdana, Arial">quote:</font><hr>Cum catapultae proscriptae erunt tum soli proscripti catapultas habebunt.<hr></blockquote>
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: Data mining a webpage
 
Similar Threads
Toggle Links Upon Dropdown Menu Selection
Dynamic Jsp coding
&nbsp; ...
Help wanted on control select/option by javascript
Speed up Application Created USing Servlets and JSP