wood burning stoves*
The moose likes Other Open Source Projects and the fly likes crawl dynamic web page using htmlunit Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login


Win a copy of Murach's Java Servlets and JSP this week in the Servlets forum!
JavaRanch » Java Forums » Products » Other Open Source Projects
Bookmark "crawl dynamic web page using htmlunit" Watch "crawl dynamic web page using htmlunit" New topic
Author

crawl dynamic web page using htmlunit

Shanmuga Narayanan.R
Greenhorn

Joined: Sep 29, 2013
Posts: 3
Hi,

I am using Windows XP OS and platform is on Java.

How to crawl data from a dynamic webpage, which uses infinite scrolling to retrieve data dynamically, just like facebook's news feed or like flipkart's loading products dynamically, link : http://www.flipkart.com/ebooks/science-technology/pr?sid=ixq,y63&otracker=nmenu_sub_books-media_Science%20%26%20Technology.

I searched the web got this link : http://stackoverflow.com/questions/12119610/crawl-dynamic-web-page-using-htmlunit

Is there any other tool which can crawl dynamic contents as mentioned above .

Thanks,
Shanmuga Narayanan.R
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: crawl dynamic web page using htmlunit
 
Similar Threads
How do I crawl web pages using JSoup or HtmlUnit?
Http Form Post Through Java Code
How to scroll down a web page using htmlunit 2.12
Vulnerability tracker
Java code for extracting data from a HTML Table from a web page