File APIs for Java Developers
Manipulate DOC, XLS, PPT, PDF and many others from your application.
http://aspose.com/file-tools
The moose likes Java in General and the fly likes guidance regrading a project Big Moose Saloon
  Search | Java FAQ | Recent Topics
Register / Login


Win a copy of The Mikado Method this week in the Agile and other Processes forum!
JavaRanch » Java Forums » Java » Java in General
Reply Bookmark "guidance regrading a project" Watch "guidance regrading a project" New topic
Author

guidance regrading a project

naveen yadav
Ranch Hand

Joined: Oct 23, 2011
Posts: 380

hi ranchers,
I have given a project assignment of a web crawler with specific reqiurements as following:

when user searches for a product name like samsung , iphone, etc. it can be any product.

1. the web crawler has to find first 10 links that Google searches for that product.
2. For each of those link It had to find images , link, contact detail ,article , facebook page,twitter page.
3. display all these info in a html page



Now i have specific questions:
how can i find first 10 pages of Google for particular input (in my case a product) ?
Is there third-party library which can be useful ?

Any guidance in this regard be appreciated.
Jesper de Jong
Java Cowboy
Bartender

Joined: Aug 16, 2005
Posts: 12929
    
    3

Google has an API for doing searches from within a program: Google Custom Search API


Java Beginners FAQ - JavaRanch SCJP FAQ - The Java Tutorial - Java SE 7 API documentation
Scala Notes - My blog about Scala
naveen yadav
Ranch Hand

Joined: Oct 23, 2011
Posts: 380

i have got the api key. do i have to set the custom search engine ?
 
I agree. Here's the link: http://zeroturnaround.com/jrebel - it saves me about five hours per week
 
subject: guidance regrading a project
 
Similar Threads
Maven and hibernate ..using them together..
What resources would be required for a java based web crawler
Using Hibernate with Maven
JSP Crawler
Crawler