This week's book giveaways are in the Java EE and JavaScript forums.
We're giving away four copies each of The Java EE 7 Tutorial Volume 1 or Volume 2(winners choice) and jQuery UI in Action and have the authors on-line!
See this thread and this one for details.
The moose likes Other Open Source Projects and the fly likes crawl dynamic web page using htmlunit Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login


Win a copy of The Java EE 7 Tutorial Volume 1 or Volume 2 this week in the Java EE forum
or jQuery UI in Action in the JavaScript forum!
JavaRanch » Java Forums » Products » Other Open Source Projects
Bookmark "crawl dynamic web page using htmlunit" Watch "crawl dynamic web page using htmlunit" New topic
Author

crawl dynamic web page using htmlunit

Shanmuga Narayanan.R
Greenhorn

Joined: Sep 29, 2013
Posts: 3
Hi,

I am using Windows XP OS and platform is on Java.

How to crawl data from a dynamic webpage, which uses infinite scrolling to retrieve data dynamically, just like facebook's news feed or like flipkart's loading products dynamically, link : http://www.flipkart.com/ebooks/science-technology/pr?sid=ixq,y63&otracker=nmenu_sub_books-media_Science%20%26%20Technology.

I searched the web got this link : http://stackoverflow.com/questions/12119610/crawl-dynamic-web-page-using-htmlunit

Is there any other tool which can crawl dynamic contents as mentioned above .

Thanks,
Shanmuga Narayanan.R
 
With a little knowledge, a cast iron skillet is non-stick and lasts a lifetime.
 
subject: crawl dynamic web page using htmlunit