Hi, am trying to see if I can make a GWT site more crawlable by detecting whenever a web bot visits, I'd invoke HtmlUnit to download (internally) the web page and return to the bot.
The only error I see is the UnknownHostException - make sure that host is not blocked from the machine where this code runs. That seems a network issue, though, not anything to do with HtmlUnit.
That the Assert in line 15 fails would obviously be expected.
Joined: Feb 01, 2013
Thanks but that URL was copied from my browser window after having found the site and loaded it in the browser so it's accessible.
It is also complaining about CSS with the following...
Joined: Mar 22, 2005
If the server sends malformed CSS then there's nothing HtmUnit can do about that. But for the purposes HtmlUnit is used CSS problems are generally inconseqeuntial. I think there's some configuration setting through which CSS error reporting can be turned off.