| Author |
guidance regrading a project
|
naveen yadav
Ranch Hand
Joined: Oct 23, 2011
Posts: 380
|
|
hi ranchers,
I have given a project assignment of a web crawler with specific reqiurements as following:
when user searches for a product name like samsung , iphone, etc. it can be any product.
1. the web crawler has to find first 10 links that Google searches for that product.
2. For each of those link It had to find images , link, contact detail ,article , facebook page,twitter page.
3. display all these info in a html page
Now i have specific questions:
how can i find first 10 pages of Google for particular input (in my case a product) ?
Is there third-party library which can be useful ?
Any guidance in this regard be appreciated.
|
 |
Jesper de Jong
Java Cowboy
Bartender
Joined: Aug 16, 2005
Posts: 12929
|
|
|
Google has an API for doing searches from within a program: Google Custom Search API
|
Java Beginners FAQ - JavaRanch SCJP FAQ - The Java Tutorial - Java SE 7 API documentation
Scala Notes - My blog about Scala
|
 |
naveen yadav
Ranch Hand
Joined: Oct 23, 2011
Posts: 380
|
|
|
i have got the api key. do i have to set the custom search engine ?
|
 |
 |
|
|
subject: guidance regrading a project
|
|
|