aspose file tools*
The moose likes Beginning Java and the fly likes Web Scraping Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login
JavaRanch » Java Forums » Java » Beginning Java
Bookmark "Web Scraping" Watch "Web Scraping" New topic
Author

Web Scraping

Kris
Greenhorn

Joined: Nov 13, 2005
Posts: 4
How can we include a browser to our application?If we include that ,how can we trace out the links corresponding to a particular topic?
jiju ka
Ranch Hand

Joined: Oct 12, 2004
Posts: 306
You need to specify your application. If it is a client server application where do you want to have browser available. What are you trying to browse using browser?


how can we trace out the links corresponding to a particular topic?

Please detail topic, link and what is it for.
Stan James
(instanceof Sidekick)
Ranch Hand

Joined: Jan 29, 2003
Posts: 8791
Including a full-blown browser in a Swing app can be a big deal. Just showing very simple HTML is easy with a JEditorPane. You'll have to write link following, buttons like forward, back, reload. Supporting javascript, css and all the goodies is much harder. Google for commercial solutions like Clue and Ice.


A good question is never answered. It is not a bolt to be tightened into place but a seed to be planted and to bear more seed toward the hope of greening the landscape of the idea. John Ciardi
Kris
Greenhorn

Joined: Nov 13, 2005
Posts: 4
Acually i have to make a personalised web browser. so i have to include a web page in my application.In the mean time i have to trace out where the search link goes.Suppose am serching for a partiular book like "computer",from the next search onwards i have to get the link of that topics only.I want to avoid unnecessary topics .I think u people got my idea.My doubt occurs in this point "how can we trace out a link when we search for a particular topic within the application". I read from the books that it is possible by Xquery.but how can i use that?
jiju ka
Ranch Hand

Joined: Oct 12, 2004
Posts: 306

Acually i have to make a personalised web browser. so i have to include a web page in my application.In the mean time i have to trace out where the search link goes.Suppose am serching for a partiular book like "computer",from the next search onwards i have to get the link of that topics only.I want to avoid unnecessary topics .I think u people got my idea.My doubt occurs in this point "how can we trace out a link when we search for a particular topic within the application". I read from the books that it is possible by Xquery.but how can i use that?

You are saying you are creating a personalized browser. Is search one of the feature of your browser?

When you say browser, what is it going to be used for? Is it a web browser or just a user interface to your application.?


how can we trace out a link when we search for a particular topic within the application

What does trace contain? I assume link as a url to a product in your application. How is your user going to use the trace? Does trace contain steps to reach the product?
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: Web Scraping