Granny's Programming Pearls
"inside of every large program is a small program struggling to get out"
JavaRanch.com/granny.jsp
Win a copy of Soft Skills: The software developer's life manual this week in the Jobs Discussion forum!
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

crawl dynamic web page using htmlunit

 
Shanmuga Narayanan.R
Greenhorn
Posts: 3
  • 0
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi,

I am using Windows XP OS and platform is on Java.

How to crawl data from a dynamic webpage, which uses infinite scrolling to retrieve data dynamically, just like facebook's news feed or like flipkart's loading products dynamically, link : http://www.flipkart.com/ebooks/science-technology/pr?sid=ixq,y63&otracker=nmenu_sub_books-media_Science%20%26%20Technology.

I searched the web got this link : http://stackoverflow.com/questions/12119610/crawl-dynamic-web-page-using-htmlunit

Is there any other tool which can crawl dynamic contents as mentioned above .

Thanks,
Shanmuga Narayanan.R
 
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic