Shanmuga Narayanan.R

Hi,

I am using Windows XP OS and platform is on Java.

How to crawl data from a dynamic webpage, which uses infinite scrolling to retrieve data dynamically, just like facebook's news feed or like flipkart's loading products dynamically, link : http://www.flipkart.com/ebooks/science-technology/pr?sid=ixq,y63&otracker=nmenu_sub_books-media_Science%20%26%20Technology.

I searched the web got this link : http://stackoverflow.com/questions/12119610/crawl-dynamic-web-page-using-htmlunit

Is there any other tool which can crawl dynamic contents as mentioned above .

Thanks,
Shanmuga Narayanan.R

Hello to all,

Am using htmlunit 2.12 in java

I have a web page which continues to load the contents when only scrolling down the page.
Ex : Flipkart

So, I want a way to scroll the page pragmatically by using HtmlUnit 2.12

The code goes like this

// myHtmlPage.executeJavaScript("window.scrollBy(0,600)");

Is there any alternate way to scroll down the page in htmlunit 2.12?

Any help would be greatly appreciated.

Thanks in advance