This week's book giveaway is in the Android forum.
We're giving away four copies of Head First Android and have Dawn & David Griffiths on-line!
See this thread for details.
The moose likes Other Application Frameworks and the fly likes emulating a synchronous html request Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login

Win a copy of Head First Android this week in the Android forum!
JavaRanch » Java Forums » Frameworks » Other Application Frameworks
Bookmark "emulating a synchronous html request" Watch "emulating a synchronous html request" New topic

emulating a synchronous html request

Fred Scott

Joined: Aug 20, 2011
Posts: 2
hello, i found this forum entry:

and looked over this link:

I am looking for something unusual. I wish to automatically parse the HTML (and possibly get a screenshot) of some websites that seem to be circumventing asynchronous HTML requests.

Some sites are built so that if you use one of the many asynchronous methods that are provided in many programming examples that you always return a page that doesn't match what is currently there. It is like they are "masking" their page from automated parsing.

(If you attempt to do a GetURL, or LoadStrings or all of the other methods that I have seen, you make an asynchronous request. The sites in question thwart it by rendering content you don't want.)

Is it possible to emulate a synchronous HTML request and still get the benefits of HTML parsing and/or screenshots? Thanks.

Fred Scott

Joined: Aug 20, 2011
Posts: 2

i hope i'm not bumping this thread too soon. However, does anyone have any thoughts about my question?

I agree. Here's the link:
subject: emulating a synchronous html request
It's not a secret anymore!