wood burning stoves*
The moose likes Other Open Source Projects and the fly likes crawl dynamic web page using htmlunit Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login

Win a copy of Murach's Java Servlets and JSP this week in the Servlets forum!
JavaRanch » Java Forums » Products » Other Open Source Projects
Bookmark "crawl dynamic web page using htmlunit" Watch "crawl dynamic web page using htmlunit" New topic

crawl dynamic web page using htmlunit

Shanmuga Narayanan.R

Joined: Sep 29, 2013
Posts: 3

I am using Windows XP OS and platform is on Java.

How to crawl data from a dynamic webpage, which uses infinite scrolling to retrieve data dynamically, just like facebook's news feed or like flipkart's loading products dynamically, link : http://www.flipkart.com/ebooks/science-technology/pr?sid=ixq,y63&otracker=nmenu_sub_books-media_Science%20%26%20Technology.

I searched the web got this link : http://stackoverflow.com/questions/12119610/crawl-dynamic-web-page-using-htmlunit

Is there any other tool which can crawl dynamic contents as mentioned above .

Shanmuga Narayanan.R
I agree. Here's the link: http://aspose.com/file-tools
subject: crawl dynamic web page using htmlunit
Similar Threads
How do I crawl web pages using JSoup or HtmlUnit?
Http Form Post Through Java Code
How to scroll down a web page using htmlunit 2.12
Vulnerability tracker
Java code for extracting data from a HTML Table from a web page