This week's giveaway is in the EJB and other Java EE Technologies forum.
We're giving away four copies of EJB 3 in Action and have Debu Panda, Reza Rahman, Ryan Cuprak, and Michael Remijan on-line!
See this thread for details.
The moose likes Java in General and the fly likes guidance regrading a project Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login

Win a copy of EJB 3 in Action this week in the EJB and other Java EE Technologies forum!
JavaRanch » Java Forums » Java » Java in General
Bookmark "guidance regrading a project" Watch "guidance regrading a project" New topic

guidance regrading a project

naveen yadav
Ranch Hand

Joined: Oct 23, 2011
Posts: 384

hi ranchers,
I have given a project assignment of a web crawler with specific reqiurements as following:

when user searches for a product name like samsung , iphone, etc. it can be any product.

1. the web crawler has to find first 10 links that Google searches for that product.
2. For each of those link It had to find images , link, contact detail ,article , facebook page,twitter page.
3. display all these info in a html page

Now i have specific questions:
how can i find first 10 pages of Google for particular input (in my case a product) ?
Is there third-party library which can be useful ?

Any guidance in this regard be appreciated.
Jesper de Jong
Java Cowboy
Saloon Keeper

Joined: Aug 16, 2005
Posts: 13868

Google has an API for doing searches from within a program: Google Custom Search API

Java Beginners FAQ - JavaRanch SCJP FAQ - The Java Tutorial - Java SE 7 API documentation
Scala Notes - My blog about Scala
naveen yadav
Ranch Hand

Joined: Oct 23, 2011
Posts: 384

i have got the api key. do i have to set the custom search engine ?
I agree. Here's the link:
subject: guidance regrading a project
Similar Threads
Maven and hibernate ..using them together..
JSP Crawler
What resources would be required for a java based web crawler
Using Hibernate with Maven