This week's book giveaway is in the Servlets forum.
We're giving away four copies of Murach's Java Servlets and JSP and have Joel Murach on-line!
See this thread for details.
The moose likes Java in General and the fly likes Parsing Webpage and Links Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login

Win a copy of Murach's Java Servlets and JSP this week in the Servlets forum!
JavaRanch » Java Forums » Java » Java in General
Bookmark "Parsing Webpage and Links" Watch "Parsing Webpage and Links" New topic

Parsing Webpage and Links

maverickml venkatesh

Joined: Aug 17, 2011
Posts: 8

Sorry if I had posted this in the wrong forum.

I have a webpage with links in a table. All i need to do is to navigate to each of these links and gather information from those pages.

As of now i can think of writing web crawler in java (again this has to be supported by the site)

Any other solutions like collecting the webpage response and HTML parsing the same.

Please suggest
Tim Moores

Joined: Sep 21, 2011
Posts: 2408
The HttpUnit library (or jWebUnit, which builds on top of it) is perfect for that.
I agree. Here's the link:
subject: Parsing Webpage and Links
Similar Threads
insert multi language
Is your company/clients moving towards Web 2.0?
Save File As...
scanning the webpage
using string value as a variable name