This week's giveaway is in the Android forum.
We're giving away four copies of Android Security Essentials Live Lessons and have Godfrey Nolan on-line!
See this thread for details.
The moose likes Java in General and the fly likes guidance regrading a project Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login

Win a copy of Android Security Essentials Live Lessons this week in the Android forum!
JavaRanch » Java Forums » Java » Java in General
Bookmark "guidance regrading a project" Watch "guidance regrading a project" New topic

guidance regrading a project

naveen yadav
Ranch Hand

Joined: Oct 23, 2011
Posts: 384

hi ranchers,
I have given a project assignment of a web crawler with specific reqiurements as following:

when user searches for a product name like samsung , iphone, etc. it can be any product.

1. the web crawler has to find first 10 links that Google searches for that product.
2. For each of those link It had to find images , link, contact detail ,article , facebook page,twitter page.
3. display all these info in a html page

Now i have specific questions:
how can i find first 10 pages of Google for particular input (in my case a product) ?
Is there third-party library which can be useful ?

Any guidance in this regard be appreciated.
Jesper de Jong
Java Cowboy
Saloon Keeper

Joined: Aug 16, 2005
Posts: 14074

Google has an API for doing searches from within a program: Google Custom Search API

Java Beginners FAQ - JavaRanch SCJP FAQ - The Java Tutorial - Java SE 7 API documentation
Scala Notes - My blog about Scala
naveen yadav
Ranch Hand

Joined: Oct 23, 2011
Posts: 384

i have got the api key. do i have to set the custom search engine ?
I agree. Here's the link:
subject: guidance regrading a project
Similar Threads
What resources would be required for a java based web crawler
Using Hibernate with Maven
Maven and hibernate ..using them together..
JSP Crawler